2023-07-18 23:10:01,644 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-18 23:10:01,918 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5 2023-07-18 23:10:01,918 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot timeout: 13 mins 2023-07-18 23:10:01,960 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-18 23:10:02,269 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-18 23:10:02,269 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/cluster_58864cd1-a7cd-0177-9e77-6a825cf5c04f, deleteOnExit=true 2023-07-18 23:10:02,270 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-18 23:10:02,270 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/test.cache.data in system properties and HBase conf 2023-07-18 23:10:02,271 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/hadoop.tmp.dir in system properties and HBase conf 2023-07-18 23:10:02,271 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/hadoop.log.dir in system properties and HBase conf 2023-07-18 23:10:02,272 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-18 23:10:02,272 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-18 23:10:02,273 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-18 23:10:02,707 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-18 23:10:02,714 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-18 23:10:02,715 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-18 23:10:02,715 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-18 23:10:02,716 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-18 23:10:02,716 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-18 23:10:02,716 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-18 23:10:02,717 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-18 23:10:02,717 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-18 23:10:02,718 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-18 23:10:02,718 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/nfs.dump.dir in system properties and HBase conf 2023-07-18 23:10:02,719 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/java.io.tmpdir in system properties and HBase conf 2023-07-18 23:10:02,719 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-18 23:10:02,719 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-18 23:10:02,720 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-18 23:10:03,363 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-18 23:10:03,368 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-18 23:10:03,703 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-18 23:10:03,941 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-18 23:10:03,955 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 23:10:04,001 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 23:10:04,036 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/java.io.tmpdir/Jetty_localhost_38031_hdfs____qucotv/webapp 2023-07-18 23:10:04,211 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38031 2023-07-18 23:10:04,256 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-18 23:10:04,256 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-18 23:10:04,793 WARN [Listener at localhost/45655] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-18 23:10:04,892 WARN [Listener at localhost/45655] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-18 23:10:04,922 WARN [Listener at localhost/45655] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 23:10:04,931 INFO [Listener at localhost/45655] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 23:10:04,940 INFO [Listener at localhost/45655] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/java.io.tmpdir/Jetty_localhost_39587_datanode____9lt12t/webapp 2023-07-18 23:10:05,059 INFO [Listener at localhost/45655] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39587 2023-07-18 23:10:05,632 WARN [Listener at localhost/34765] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-18 23:10:05,672 WARN [Listener at localhost/34765] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-18 23:10:05,677 WARN [Listener at localhost/34765] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 23:10:05,679 INFO [Listener at localhost/34765] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 23:10:05,690 INFO [Listener at localhost/34765] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/java.io.tmpdir/Jetty_localhost_41193_datanode____aupqol/webapp 2023-07-18 23:10:05,832 INFO [Listener at localhost/34765] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41193 2023-07-18 23:10:05,858 WARN [Listener at localhost/35195] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-18 23:10:05,917 WARN [Listener at localhost/35195] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-18 23:10:05,923 WARN [Listener at localhost/35195] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 23:10:05,925 INFO [Listener at localhost/35195] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 23:10:05,955 INFO [Listener at localhost/35195] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/java.io.tmpdir/Jetty_localhost_39993_datanode____.log3vw/webapp 2023-07-18 23:10:06,144 INFO [Listener at localhost/35195] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39993 2023-07-18 23:10:06,186 WARN [Listener at localhost/42081] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-18 23:10:06,513 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4bfb4937d2685728: Processing first storage report for DS-83eeca1d-a46d-4502-af7c-48c1cd895106 from datanode 9f1008fa-b258-4a68-bf5e-75608439f464 2023-07-18 23:10:06,516 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4bfb4937d2685728: from storage DS-83eeca1d-a46d-4502-af7c-48c1cd895106 node DatanodeRegistration(127.0.0.1:46307, datanodeUuid=9f1008fa-b258-4a68-bf5e-75608439f464, infoPort=44605, infoSecurePort=0, ipcPort=34765, storageInfo=lv=-57;cid=testClusterID;nsid=135037649;c=1689721803461), blocks: 0, hasStaleStorage: true, processing time: 3 msecs, invalidatedBlocks: 0 2023-07-18 23:10:06,516 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x62fd9590ad4ce2d9: Processing first storage report for DS-39467baa-8808-48d2-86a7-e09d3f43fb58 from datanode 847cb047-f2f4-4432-a2f5-fe36d5f18a78 2023-07-18 23:10:06,516 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x62fd9590ad4ce2d9: from storage DS-39467baa-8808-48d2-86a7-e09d3f43fb58 node DatanodeRegistration(127.0.0.1:37649, datanodeUuid=847cb047-f2f4-4432-a2f5-fe36d5f18a78, infoPort=32969, infoSecurePort=0, ipcPort=42081, storageInfo=lv=-57;cid=testClusterID;nsid=135037649;c=1689721803461), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-18 23:10:06,516 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4bfb4937d2685728: Processing first storage report for DS-bc0c07b1-a90b-4bb7-86dd-b0e40e96de48 from datanode 9f1008fa-b258-4a68-bf5e-75608439f464 2023-07-18 23:10:06,517 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4bfb4937d2685728: from storage DS-bc0c07b1-a90b-4bb7-86dd-b0e40e96de48 node DatanodeRegistration(127.0.0.1:46307, datanodeUuid=9f1008fa-b258-4a68-bf5e-75608439f464, infoPort=44605, infoSecurePort=0, ipcPort=34765, storageInfo=lv=-57;cid=testClusterID;nsid=135037649;c=1689721803461), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-18 23:10:06,517 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x62fd9590ad4ce2d9: Processing first storage report for DS-80f00dbe-3f91-405b-aa51-5f4b3478daeb from datanode 847cb047-f2f4-4432-a2f5-fe36d5f18a78 2023-07-18 23:10:06,517 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x62fd9590ad4ce2d9: from storage DS-80f00dbe-3f91-405b-aa51-5f4b3478daeb node DatanodeRegistration(127.0.0.1:37649, datanodeUuid=847cb047-f2f4-4432-a2f5-fe36d5f18a78, infoPort=32969, infoSecurePort=0, ipcPort=42081, storageInfo=lv=-57;cid=testClusterID;nsid=135037649;c=1689721803461), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-18 23:10:06,518 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xdcf9236b26e0f6a9: Processing first storage report for DS-e75af02c-9ee7-4992-b74d-e60bf3240642 from datanode 74c8d802-e18c-45af-96e4-7708018042c6 2023-07-18 23:10:06,518 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xdcf9236b26e0f6a9: from storage DS-e75af02c-9ee7-4992-b74d-e60bf3240642 node DatanodeRegistration(127.0.0.1:46261, datanodeUuid=74c8d802-e18c-45af-96e4-7708018042c6, infoPort=44873, infoSecurePort=0, ipcPort=35195, storageInfo=lv=-57;cid=testClusterID;nsid=135037649;c=1689721803461), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-18 23:10:06,518 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xdcf9236b26e0f6a9: Processing first storage report for DS-a4c45e57-bd70-42d4-b2ef-171eb5ec1aba from datanode 74c8d802-e18c-45af-96e4-7708018042c6 2023-07-18 23:10:06,519 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xdcf9236b26e0f6a9: from storage DS-a4c45e57-bd70-42d4-b2ef-171eb5ec1aba node DatanodeRegistration(127.0.0.1:46261, datanodeUuid=74c8d802-e18c-45af-96e4-7708018042c6, infoPort=44873, infoSecurePort=0, ipcPort=35195, storageInfo=lv=-57;cid=testClusterID;nsid=135037649;c=1689721803461), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-18 23:10:06,779 DEBUG [Listener at localhost/42081] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5 2023-07-18 23:10:06,901 INFO [Listener at localhost/42081] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/cluster_58864cd1-a7cd-0177-9e77-6a825cf5c04f/zookeeper_0, clientPort=61306, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/cluster_58864cd1-a7cd-0177-9e77-6a825cf5c04f/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/cluster_58864cd1-a7cd-0177-9e77-6a825cf5c04f/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-18 23:10:06,930 INFO [Listener at localhost/42081] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=61306 2023-07-18 23:10:06,942 INFO [Listener at localhost/42081] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 23:10:06,945 INFO [Listener at localhost/42081] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 23:10:07,664 INFO [Listener at localhost/42081] util.FSUtils(471): Created version file at hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054 with version=8 2023-07-18 23:10:07,664 INFO [Listener at localhost/42081] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/hbase-staging 2023-07-18 23:10:08,059 INFO [Listener at localhost/42081] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-18 23:10:08,731 INFO [Listener at localhost/42081] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-18 23:10:08,768 INFO [Listener at localhost/42081] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 23:10:08,769 INFO [Listener at localhost/42081] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-18 23:10:08,769 INFO [Listener at localhost/42081] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-18 23:10:08,770 INFO [Listener at localhost/42081] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 23:10:08,770 INFO [Listener at localhost/42081] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-18 23:10:08,948 INFO [Listener at localhost/42081] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-18 23:10:09,040 DEBUG [Listener at localhost/42081] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-18 23:10:09,136 INFO [Listener at localhost/42081] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46651 2023-07-18 23:10:09,150 INFO [Listener at localhost/42081] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 23:10:09,153 INFO [Listener at localhost/42081] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 23:10:09,185 INFO [Listener at localhost/42081] zookeeper.RecoverableZooKeeper(93): Process identifier=master:46651 connecting to ZooKeeper ensemble=127.0.0.1:61306 2023-07-18 23:10:09,258 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:466510x0, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-18 23:10:09,263 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:46651-0x1017ab3231c0000 connected 2023-07-18 23:10:09,341 DEBUG [Listener at localhost/42081] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-18 23:10:09,343 DEBUG [Listener at localhost/42081] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 23:10:09,362 DEBUG [Listener at localhost/42081] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-18 23:10:09,383 DEBUG [Listener at localhost/42081] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46651 2023-07-18 23:10:09,389 DEBUG [Listener at localhost/42081] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46651 2023-07-18 23:10:09,391 DEBUG [Listener at localhost/42081] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46651 2023-07-18 23:10:09,398 DEBUG [Listener at localhost/42081] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46651 2023-07-18 23:10:09,403 DEBUG [Listener at localhost/42081] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46651 2023-07-18 23:10:09,415 INFO [Listener at localhost/42081] master.HMaster(444): hbase.rootdir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054, hbase.cluster.distributed=false 2023-07-18 23:10:09,517 INFO [Listener at localhost/42081] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-18 23:10:09,518 INFO [Listener at localhost/42081] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 23:10:09,518 INFO [Listener at localhost/42081] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-18 23:10:09,518 INFO [Listener at localhost/42081] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-18 23:10:09,518 INFO [Listener at localhost/42081] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 23:10:09,519 INFO [Listener at localhost/42081] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-18 23:10:09,525 INFO [Listener at localhost/42081] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-18 23:10:09,529 INFO [Listener at localhost/42081] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45387 2023-07-18 23:10:09,532 INFO [Listener at localhost/42081] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-18 23:10:09,539 DEBUG [Listener at localhost/42081] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-18 23:10:09,540 INFO [Listener at localhost/42081] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 23:10:09,543 INFO [Listener at localhost/42081] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 23:10:09,545 INFO [Listener at localhost/42081] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45387 connecting to ZooKeeper ensemble=127.0.0.1:61306 2023-07-18 23:10:09,557 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:453870x0, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-18 23:10:09,564 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:45387-0x1017ab3231c0001 connected 2023-07-18 23:10:09,564 DEBUG [Listener at localhost/42081] zookeeper.ZKUtil(164): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-18 23:10:09,566 DEBUG [Listener at localhost/42081] zookeeper.ZKUtil(164): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 23:10:09,568 DEBUG [Listener at localhost/42081] zookeeper.ZKUtil(164): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-18 23:10:09,578 DEBUG [Listener at localhost/42081] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45387 2023-07-18 23:10:09,579 DEBUG [Listener at localhost/42081] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45387 2023-07-18 23:10:09,580 DEBUG [Listener at localhost/42081] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45387 2023-07-18 23:10:09,580 DEBUG [Listener at localhost/42081] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45387 2023-07-18 23:10:09,581 DEBUG [Listener at localhost/42081] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45387 2023-07-18 23:10:09,600 INFO [Listener at localhost/42081] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-18 23:10:09,600 INFO [Listener at localhost/42081] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 23:10:09,600 INFO [Listener at localhost/42081] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-18 23:10:09,601 INFO [Listener at localhost/42081] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-18 23:10:09,601 INFO [Listener at localhost/42081] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 23:10:09,602 INFO [Listener at localhost/42081] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-18 23:10:09,602 INFO [Listener at localhost/42081] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-18 23:10:09,606 INFO [Listener at localhost/42081] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45431 2023-07-18 23:10:09,606 INFO [Listener at localhost/42081] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-18 23:10:09,607 DEBUG [Listener at localhost/42081] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-18 23:10:09,608 INFO [Listener at localhost/42081] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 23:10:09,611 INFO [Listener at localhost/42081] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 23:10:09,615 INFO [Listener at localhost/42081] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45431 connecting to ZooKeeper ensemble=127.0.0.1:61306 2023-07-18 23:10:09,624 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:454310x0, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-18 23:10:09,628 DEBUG [Listener at localhost/42081] zookeeper.ZKUtil(164): regionserver:454310x0, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-18 23:10:09,629 DEBUG [Listener at localhost/42081] zookeeper.ZKUtil(164): regionserver:454310x0, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 23:10:09,630 DEBUG [Listener at localhost/42081] zookeeper.ZKUtil(164): regionserver:454310x0, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-18 23:10:09,631 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:45431-0x1017ab3231c0002 connected 2023-07-18 23:10:09,631 DEBUG [Listener at localhost/42081] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45431 2023-07-18 23:10:09,632 DEBUG [Listener at localhost/42081] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45431 2023-07-18 23:10:09,638 DEBUG [Listener at localhost/42081] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45431 2023-07-18 23:10:09,642 DEBUG [Listener at localhost/42081] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45431 2023-07-18 23:10:09,642 DEBUG [Listener at localhost/42081] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45431 2023-07-18 23:10:09,654 INFO [Listener at localhost/42081] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-18 23:10:09,655 INFO [Listener at localhost/42081] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 23:10:09,655 INFO [Listener at localhost/42081] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-18 23:10:09,655 INFO [Listener at localhost/42081] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-18 23:10:09,655 INFO [Listener at localhost/42081] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 23:10:09,655 INFO [Listener at localhost/42081] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-18 23:10:09,656 INFO [Listener at localhost/42081] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-18 23:10:09,657 INFO [Listener at localhost/42081] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38625 2023-07-18 23:10:09,658 INFO [Listener at localhost/42081] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-18 23:10:09,660 DEBUG [Listener at localhost/42081] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-18 23:10:09,661 INFO [Listener at localhost/42081] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 23:10:09,663 INFO [Listener at localhost/42081] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 23:10:09,664 INFO [Listener at localhost/42081] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38625 connecting to ZooKeeper ensemble=127.0.0.1:61306 2023-07-18 23:10:09,668 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:386250x0, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-18 23:10:09,670 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:38625-0x1017ab3231c0003 connected 2023-07-18 23:10:09,670 DEBUG [Listener at localhost/42081] zookeeper.ZKUtil(164): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-18 23:10:09,671 DEBUG [Listener at localhost/42081] zookeeper.ZKUtil(164): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 23:10:09,671 DEBUG [Listener at localhost/42081] zookeeper.ZKUtil(164): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-18 23:10:09,679 DEBUG [Listener at localhost/42081] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38625 2023-07-18 23:10:09,679 DEBUG [Listener at localhost/42081] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38625 2023-07-18 23:10:09,682 DEBUG [Listener at localhost/42081] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38625 2023-07-18 23:10:09,687 DEBUG [Listener at localhost/42081] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38625 2023-07-18 23:10:09,690 DEBUG [Listener at localhost/42081] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38625 2023-07-18 23:10:09,692 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,46651,1689721807857 2023-07-18 23:10:09,706 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-18 23:10:09,707 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,46651,1689721807857 2023-07-18 23:10:09,733 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-18 23:10:09,733 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-18 23:10:09,734 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-18 23:10:09,734 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-18 23:10:09,734 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 23:10:09,736 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-18 23:10:09,737 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-18 23:10:09,738 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,46651,1689721807857 from backup master directory 2023-07-18 23:10:09,744 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,46651,1689721807857 2023-07-18 23:10:09,744 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-18 23:10:09,745 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-18 23:10:09,745 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,46651,1689721807857 2023-07-18 23:10:09,749 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-18 23:10:09,758 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-18 23:10:09,895 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/hbase.id with ID: b0f4a327-4215-4933-bffb-71bdbffbab2a 2023-07-18 23:10:09,960 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 23:10:09,978 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 23:10:10,034 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x7f0afdd0 to 127.0.0.1:61306 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 23:10:10,074 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@41e1a89d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 23:10:10,100 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-18 23:10:10,102 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-18 23:10:10,121 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-18 23:10:10,121 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-18 23:10:10,124 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-18 23:10:10,129 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-18 23:10:10,131 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-18 23:10:10,172 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/MasterData/data/master/store-tmp 2023-07-18 23:10:10,235 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 23:10:10,235 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-18 23:10:10,236 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 23:10:10,236 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 23:10:10,236 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-18 23:10:10,236 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 23:10:10,236 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 23:10:10,236 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-18 23:10:10,238 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/MasterData/WALs/jenkins-hbase4.apache.org,46651,1689721807857 2023-07-18 23:10:10,262 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46651%2C1689721807857, suffix=, logDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/MasterData/WALs/jenkins-hbase4.apache.org,46651,1689721807857, archiveDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/MasterData/oldWALs, maxLogs=10 2023-07-18 23:10:10,352 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46307,DS-83eeca1d-a46d-4502-af7c-48c1cd895106,DISK] 2023-07-18 23:10:10,352 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46261,DS-e75af02c-9ee7-4992-b74d-e60bf3240642,DISK] 2023-07-18 23:10:10,352 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37649,DS-39467baa-8808-48d2-86a7-e09d3f43fb58,DISK] 2023-07-18 23:10:10,371 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-18 23:10:10,463 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/MasterData/WALs/jenkins-hbase4.apache.org,46651,1689721807857/jenkins-hbase4.apache.org%2C46651%2C1689721807857.1689721810274 2023-07-18 23:10:10,464 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46261,DS-e75af02c-9ee7-4992-b74d-e60bf3240642,DISK], DatanodeInfoWithStorage[127.0.0.1:46307,DS-83eeca1d-a46d-4502-af7c-48c1cd895106,DISK], DatanodeInfoWithStorage[127.0.0.1:37649,DS-39467baa-8808-48d2-86a7-e09d3f43fb58,DISK]] 2023-07-18 23:10:10,465 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-18 23:10:10,465 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 23:10:10,469 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-18 23:10:10,471 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-18 23:10:10,553 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-18 23:10:10,562 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-18 23:10:10,598 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-18 23:10:10,613 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 23:10:10,620 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-18 23:10:10,622 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-18 23:10:10,645 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-18 23:10:10,652 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 23:10:10,653 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62816862, jitterRate=-0.06395581364631653}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 23:10:10,654 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-18 23:10:10,655 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-18 23:10:10,678 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-18 23:10:10,678 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-18 23:10:10,681 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-18 23:10:10,683 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-18 23:10:10,720 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 36 msec 2023-07-18 23:10:10,720 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-18 23:10:10,751 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-18 23:10:10,760 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-18 23:10:10,797 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-18 23:10:10,805 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-18 23:10:10,806 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-18 23:10:10,815 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-18 23:10:10,821 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-18 23:10:10,825 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 23:10:10,827 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-18 23:10:10,828 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-18 23:10:10,843 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-18 23:10:10,848 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-18 23:10:10,848 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-18 23:10:10,849 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-18 23:10:10,849 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 23:10:10,848 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-18 23:10:10,852 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,46651,1689721807857, sessionid=0x1017ab3231c0000, setting cluster-up flag (Was=false) 2023-07-18 23:10:10,871 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 23:10:10,878 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-18 23:10:10,884 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,46651,1689721807857 2023-07-18 23:10:10,891 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 23:10:10,898 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-18 23:10:10,901 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,46651,1689721807857 2023-07-18 23:10:10,905 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/.tmp 2023-07-18 23:10:11,005 INFO [RS:0;jenkins-hbase4:45387] regionserver.HRegionServer(951): ClusterId : b0f4a327-4215-4933-bffb-71bdbffbab2a 2023-07-18 23:10:11,014 INFO [RS:2;jenkins-hbase4:38625] regionserver.HRegionServer(951): ClusterId : b0f4a327-4215-4933-bffb-71bdbffbab2a 2023-07-18 23:10:11,019 INFO [RS:1;jenkins-hbase4:45431] regionserver.HRegionServer(951): ClusterId : b0f4a327-4215-4933-bffb-71bdbffbab2a 2023-07-18 23:10:11,041 DEBUG [RS:1;jenkins-hbase4:45431] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-18 23:10:11,041 DEBUG [RS:0;jenkins-hbase4:45387] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-18 23:10:11,042 DEBUG [RS:2;jenkins-hbase4:38625] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-18 23:10:11,066 DEBUG [RS:1;jenkins-hbase4:45431] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-18 23:10:11,067 DEBUG [RS:1;jenkins-hbase4:45431] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-18 23:10:11,067 DEBUG [RS:0;jenkins-hbase4:45387] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-18 23:10:11,067 DEBUG [RS:0;jenkins-hbase4:45387] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-18 23:10:11,070 DEBUG [RS:2;jenkins-hbase4:38625] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-18 23:10:11,070 DEBUG [RS:2;jenkins-hbase4:38625] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-18 23:10:11,072 DEBUG [RS:0;jenkins-hbase4:45387] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-18 23:10:11,074 DEBUG [RS:1;jenkins-hbase4:45431] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-18 23:10:11,074 DEBUG [RS:0;jenkins-hbase4:45387] zookeeper.ReadOnlyZKClient(139): Connect 0x4900bdef to 127.0.0.1:61306 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 23:10:11,075 DEBUG [RS:2;jenkins-hbase4:38625] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-18 23:10:11,092 DEBUG [RS:2;jenkins-hbase4:38625] zookeeper.ReadOnlyZKClient(139): Connect 0x746b42ad to 127.0.0.1:61306 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 23:10:11,097 DEBUG [RS:1;jenkins-hbase4:45431] zookeeper.ReadOnlyZKClient(139): Connect 0x34d84d19 to 127.0.0.1:61306 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 23:10:11,100 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-18 23:10:11,116 DEBUG [RS:0;jenkins-hbase4:45387] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@47c75abf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 23:10:11,117 DEBUG [RS:0;jenkins-hbase4:45387] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@43f8d69f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-18 23:10:11,121 DEBUG [RS:2;jenkins-hbase4:38625] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7aacb250, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 23:10:11,122 DEBUG [RS:2;jenkins-hbase4:38625] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e9329dd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-18 23:10:11,152 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 23:10:11,152 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-18 23:10:11,158 DEBUG [RS:1;jenkins-hbase4:45431] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a1fa5f2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 23:10:11,159 DEBUG [RS:1;jenkins-hbase4:45431] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b22afc9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-18 23:10:11,173 DEBUG [RS:0;jenkins-hbase4:45387] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:45387 2023-07-18 23:10:11,174 DEBUG [RS:1;jenkins-hbase4:45431] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:45431 2023-07-18 23:10:11,177 DEBUG [RS:2;jenkins-hbase4:38625] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:38625 2023-07-18 23:10:11,181 INFO [RS:1;jenkins-hbase4:45431] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-18 23:10:11,181 INFO [RS:2;jenkins-hbase4:38625] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-18 23:10:11,181 INFO [RS:0;jenkins-hbase4:45387] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-18 23:10:11,182 INFO [RS:2;jenkins-hbase4:38625] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-18 23:10:11,182 INFO [RS:1;jenkins-hbase4:45431] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-18 23:10:11,182 INFO [RS:0;jenkins-hbase4:45387] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-18 23:10:11,182 DEBUG [RS:1;jenkins-hbase4:45431] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-18 23:10:11,182 DEBUG [RS:2;jenkins-hbase4:38625] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-18 23:10:11,184 DEBUG [RS:0;jenkins-hbase4:45387] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-18 23:10:11,184 INFO [RS:2;jenkins-hbase4:38625] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 23:10:11,184 INFO [RS:1;jenkins-hbase4:45431] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 23:10:11,184 INFO [RS:0;jenkins-hbase4:45387] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 23:10:11,184 DEBUG [RS:0;jenkins-hbase4:45387] regionserver.HRegionServer(1022): About to register with Master. 2023-07-18 23:10:11,184 DEBUG [RS:2;jenkins-hbase4:38625] regionserver.HRegionServer(1022): About to register with Master. 2023-07-18 23:10:11,184 DEBUG [RS:1;jenkins-hbase4:45431] regionserver.HRegionServer(1022): About to register with Master. 2023-07-18 23:10:11,188 INFO [RS:2;jenkins-hbase4:38625] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46651,1689721807857 with isa=jenkins-hbase4.apache.org/172.31.14.131:38625, startcode=1689721809654 2023-07-18 23:10:11,188 INFO [RS:0;jenkins-hbase4:45387] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46651,1689721807857 with isa=jenkins-hbase4.apache.org/172.31.14.131:45387, startcode=1689721809516 2023-07-18 23:10:11,190 INFO [RS:1;jenkins-hbase4:45431] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46651,1689721807857 with isa=jenkins-hbase4.apache.org/172.31.14.131:45431, startcode=1689721809599 2023-07-18 23:10:11,214 DEBUG [RS:2;jenkins-hbase4:38625] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-18 23:10:11,214 DEBUG [RS:1;jenkins-hbase4:45431] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-18 23:10:11,214 DEBUG [RS:0;jenkins-hbase4:45387] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-18 23:10:11,281 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-18 23:10:11,296 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-18 23:10:11,296 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-18 23:10:11,296 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-18 23:10:11,296 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-18 23:10:11,297 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-18 23:10:11,297 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 23:10:11,297 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-18 23:10:11,297 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 23:10:11,310 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58407, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-18 23:10:11,311 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50365, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-18 23:10:11,316 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32999, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-18 23:10:11,336 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689721841336 2023-07-18 23:10:11,339 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46651] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 23:10:11,339 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-18 23:10:11,349 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-18 23:10:11,350 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46651] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 23:10:11,352 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-18 23:10:11,352 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46651] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 23:10:11,356 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-18 23:10:11,373 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-18 23:10:11,384 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-18 23:10:11,385 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-18 23:10:11,395 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-18 23:10:11,395 DEBUG [RS:1;jenkins-hbase4:45431] regionserver.HRegionServer(2830): Master is not running yet 2023-07-18 23:10:11,395 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-18 23:10:11,397 WARN [RS:1;jenkins-hbase4:45431] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-18 23:10:11,395 DEBUG [RS:0;jenkins-hbase4:45387] regionserver.HRegionServer(2830): Master is not running yet 2023-07-18 23:10:11,395 DEBUG [RS:2;jenkins-hbase4:38625] regionserver.HRegionServer(2830): Master is not running yet 2023-07-18 23:10:11,398 WARN [RS:0;jenkins-hbase4:45387] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-18 23:10:11,398 WARN [RS:2;jenkins-hbase4:38625] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-18 23:10:11,398 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-18 23:10:11,400 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-18 23:10:11,403 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-18 23:10:11,403 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-18 23:10:11,415 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-18 23:10:11,416 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-18 23:10:11,418 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689721811418,5,FailOnTimeoutGroup] 2023-07-18 23:10:11,422 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689721811419,5,FailOnTimeoutGroup] 2023-07-18 23:10:11,423 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-18 23:10:11,423 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-18 23:10:11,425 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-18 23:10:11,426 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-18 23:10:11,458 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-18 23:10:11,459 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-18 23:10:11,459 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054 2023-07-18 23:10:11,499 INFO [RS:1;jenkins-hbase4:45431] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46651,1689721807857 with isa=jenkins-hbase4.apache.org/172.31.14.131:45431, startcode=1689721809599 2023-07-18 23:10:11,500 INFO [RS:0;jenkins-hbase4:45387] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46651,1689721807857 with isa=jenkins-hbase4.apache.org/172.31.14.131:45387, startcode=1689721809516 2023-07-18 23:10:11,503 INFO [RS:2;jenkins-hbase4:38625] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46651,1689721807857 with isa=jenkins-hbase4.apache.org/172.31.14.131:38625, startcode=1689721809654 2023-07-18 23:10:11,503 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 23:10:11,508 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46651] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:11,509 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-18 23:10:11,513 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/hbase/meta/1588230740/info 2023-07-18 23:10:11,514 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-18 23:10:11,515 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 23:10:11,515 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-18 23:10:11,517 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46651] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:11,518 DEBUG [RS:0;jenkins-hbase4:45387] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054 2023-07-18 23:10:11,518 DEBUG [RS:0;jenkins-hbase4:45387] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:45655 2023-07-18 23:10:11,519 DEBUG [RS:0;jenkins-hbase4:45387] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-18 23:10:11,527 DEBUG [RS:1;jenkins-hbase4:45431] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054 2023-07-18 23:10:11,527 DEBUG [RS:1;jenkins-hbase4:45431] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:45655 2023-07-18 23:10:11,527 DEBUG [RS:1;jenkins-hbase4:45431] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-18 23:10:11,528 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46651] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:11,530 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/hbase/meta/1588230740/rep_barrier 2023-07-18 23:10:11,530 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-18 23:10:11,531 DEBUG [RS:2;jenkins-hbase4:38625] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054 2023-07-18 23:10:11,532 DEBUG [RS:2;jenkins-hbase4:38625] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:45655 2023-07-18 23:10:11,532 DEBUG [RS:2;jenkins-hbase4:38625] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-18 23:10:11,535 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 23:10:11,536 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-18 23:10:11,538 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 23:10:11,542 DEBUG [RS:1;jenkins-hbase4:45431] zookeeper.ZKUtil(162): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:11,543 WARN [RS:1;jenkins-hbase4:45431] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-18 23:10:11,543 DEBUG [RS:0;jenkins-hbase4:45387] zookeeper.ZKUtil(162): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:11,543 INFO [RS:1;jenkins-hbase4:45431] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-18 23:10:11,543 DEBUG [RS:2;jenkins-hbase4:38625] zookeeper.ZKUtil(162): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:11,543 DEBUG [RS:1;jenkins-hbase4:45431] regionserver.HRegionServer(1948): logDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/WALs/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:11,543 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45431,1689721809599] 2023-07-18 23:10:11,543 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45387,1689721809516] 2023-07-18 23:10:11,543 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38625,1689721809654] 2023-07-18 23:10:11,544 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/hbase/meta/1588230740/table 2023-07-18 23:10:11,543 WARN [RS:0;jenkins-hbase4:45387] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-18 23:10:11,543 WARN [RS:2;jenkins-hbase4:38625] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-18 23:10:11,555 INFO [RS:2;jenkins-hbase4:38625] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-18 23:10:11,552 INFO [RS:0;jenkins-hbase4:45387] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-18 23:10:11,553 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-18 23:10:11,556 DEBUG [RS:0;jenkins-hbase4:45387] regionserver.HRegionServer(1948): logDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/WALs/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:11,556 DEBUG [RS:2;jenkins-hbase4:38625] regionserver.HRegionServer(1948): logDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/WALs/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:11,563 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 23:10:11,568 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/hbase/meta/1588230740 2023-07-18 23:10:11,569 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/hbase/meta/1588230740 2023-07-18 23:10:11,574 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-18 23:10:11,579 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-18 23:10:11,583 DEBUG [RS:0;jenkins-hbase4:45387] zookeeper.ZKUtil(162): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:11,584 DEBUG [RS:1;jenkins-hbase4:45431] zookeeper.ZKUtil(162): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:11,584 DEBUG [RS:0;jenkins-hbase4:45387] zookeeper.ZKUtil(162): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:11,584 DEBUG [RS:1;jenkins-hbase4:45431] zookeeper.ZKUtil(162): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:11,585 DEBUG [RS:0;jenkins-hbase4:45387] zookeeper.ZKUtil(162): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:11,585 DEBUG [RS:1;jenkins-hbase4:45431] zookeeper.ZKUtil(162): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:11,589 DEBUG [RS:2;jenkins-hbase4:38625] zookeeper.ZKUtil(162): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:11,590 DEBUG [RS:2;jenkins-hbase4:38625] zookeeper.ZKUtil(162): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:11,590 DEBUG [RS:2;jenkins-hbase4:38625] zookeeper.ZKUtil(162): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:11,599 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 23:10:11,603 DEBUG [RS:1;jenkins-hbase4:45431] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-18 23:10:11,611 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60979067, jitterRate=-0.09134109318256378}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-18 23:10:11,611 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-18 23:10:11,611 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-18 23:10:11,611 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-18 23:10:11,611 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-18 23:10:11,611 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-18 23:10:11,611 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-18 23:10:11,603 DEBUG [RS:0;jenkins-hbase4:45387] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-18 23:10:11,604 DEBUG [RS:2;jenkins-hbase4:38625] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-18 23:10:11,619 INFO [RS:1;jenkins-hbase4:45431] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-18 23:10:11,632 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-18 23:10:11,632 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-18 23:10:11,641 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-18 23:10:11,642 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-18 23:10:11,643 INFO [RS:2;jenkins-hbase4:38625] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-18 23:10:11,644 INFO [RS:0;jenkins-hbase4:45387] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-18 23:10:11,662 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-18 23:10:11,669 INFO [RS:2;jenkins-hbase4:38625] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-18 23:10:11,670 INFO [RS:0;jenkins-hbase4:45387] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-18 23:10:11,670 INFO [RS:1;jenkins-hbase4:45431] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-18 23:10:11,678 INFO [RS:0;jenkins-hbase4:45387] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-18 23:10:11,679 INFO [RS:1;jenkins-hbase4:45431] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-18 23:10:11,678 INFO [RS:2;jenkins-hbase4:38625] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-18 23:10:11,679 INFO [RS:1;jenkins-hbase4:45431] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 23:10:11,680 INFO [RS:1;jenkins-hbase4:45431] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-18 23:10:11,679 INFO [RS:0;jenkins-hbase4:45387] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 23:10:11,682 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-18 23:10:11,679 INFO [RS:2;jenkins-hbase4:38625] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 23:10:11,682 INFO [RS:0;jenkins-hbase4:45387] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-18 23:10:11,686 INFO [RS:2;jenkins-hbase4:38625] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-18 23:10:11,691 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-18 23:10:11,696 INFO [RS:1;jenkins-hbase4:45431] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-18 23:10:11,696 INFO [RS:2;jenkins-hbase4:38625] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-18 23:10:11,696 INFO [RS:0;jenkins-hbase4:45387] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-18 23:10:11,696 DEBUG [RS:1;jenkins-hbase4:45431] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 23:10:11,696 DEBUG [RS:2;jenkins-hbase4:38625] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 23:10:11,699 DEBUG [RS:0;jenkins-hbase4:45387] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 23:10:11,699 DEBUG [RS:2;jenkins-hbase4:38625] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 23:10:11,699 DEBUG [RS:1;jenkins-hbase4:45431] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 23:10:11,699 DEBUG [RS:2;jenkins-hbase4:38625] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 23:10:11,699 DEBUG [RS:1;jenkins-hbase4:45431] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 23:10:11,699 DEBUG [RS:2;jenkins-hbase4:38625] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 23:10:11,699 DEBUG [RS:1;jenkins-hbase4:45431] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 23:10:11,700 DEBUG [RS:2;jenkins-hbase4:38625] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 23:10:11,700 DEBUG [RS:1;jenkins-hbase4:45431] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 23:10:11,700 DEBUG [RS:2;jenkins-hbase4:38625] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-18 23:10:11,700 DEBUG [RS:1;jenkins-hbase4:45431] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-18 23:10:11,699 DEBUG [RS:0;jenkins-hbase4:45387] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 23:10:11,700 DEBUG [RS:1;jenkins-hbase4:45431] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 23:10:11,700 DEBUG [RS:2;jenkins-hbase4:38625] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 23:10:11,700 DEBUG [RS:0;jenkins-hbase4:45387] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 23:10:11,700 DEBUG [RS:2;jenkins-hbase4:38625] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 23:10:11,700 DEBUG [RS:1;jenkins-hbase4:45431] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 23:10:11,700 DEBUG [RS:2;jenkins-hbase4:38625] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 23:10:11,700 DEBUG [RS:1;jenkins-hbase4:45431] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 23:10:11,701 DEBUG [RS:2;jenkins-hbase4:38625] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 23:10:11,701 DEBUG [RS:1;jenkins-hbase4:45431] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 23:10:11,700 DEBUG [RS:0;jenkins-hbase4:45387] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 23:10:11,701 DEBUG [RS:0;jenkins-hbase4:45387] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 23:10:11,701 DEBUG [RS:0;jenkins-hbase4:45387] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-18 23:10:11,701 DEBUG [RS:0;jenkins-hbase4:45387] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 23:10:11,701 DEBUG [RS:0;jenkins-hbase4:45387] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 23:10:11,702 DEBUG [RS:0;jenkins-hbase4:45387] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 23:10:11,702 DEBUG [RS:0;jenkins-hbase4:45387] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 23:10:11,706 INFO [RS:0;jenkins-hbase4:45387] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 23:10:11,706 INFO [RS:0;jenkins-hbase4:45387] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 23:10:11,706 INFO [RS:0;jenkins-hbase4:45387] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-18 23:10:11,709 INFO [RS:2;jenkins-hbase4:38625] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 23:10:11,709 INFO [RS:2;jenkins-hbase4:38625] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 23:10:11,709 INFO [RS:1;jenkins-hbase4:45431] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 23:10:11,709 INFO [RS:2;jenkins-hbase4:38625] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-18 23:10:11,709 INFO [RS:1;jenkins-hbase4:45431] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 23:10:11,709 INFO [RS:1;jenkins-hbase4:45431] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-18 23:10:11,729 INFO [RS:2;jenkins-hbase4:38625] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-18 23:10:11,729 INFO [RS:1;jenkins-hbase4:45431] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-18 23:10:11,729 INFO [RS:0;jenkins-hbase4:45387] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-18 23:10:11,734 INFO [RS:0;jenkins-hbase4:45387] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45387,1689721809516-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 23:10:11,734 INFO [RS:1;jenkins-hbase4:45431] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45431,1689721809599-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 23:10:11,734 INFO [RS:2;jenkins-hbase4:38625] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38625,1689721809654-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 23:10:11,767 INFO [RS:0;jenkins-hbase4:45387] regionserver.Replication(203): jenkins-hbase4.apache.org,45387,1689721809516 started 2023-07-18 23:10:11,795 INFO [RS:0;jenkins-hbase4:45387] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,45387,1689721809516, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45387, sessionid=0x1017ab3231c0001 2023-07-18 23:10:11,795 DEBUG [RS:0;jenkins-hbase4:45387] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-18 23:10:11,795 DEBUG [RS:0;jenkins-hbase4:45387] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:11,795 DEBUG [RS:0;jenkins-hbase4:45387] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45387,1689721809516' 2023-07-18 23:10:11,796 DEBUG [RS:0;jenkins-hbase4:45387] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-18 23:10:11,797 DEBUG [RS:0;jenkins-hbase4:45387] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-18 23:10:11,798 DEBUG [RS:0;jenkins-hbase4:45387] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-18 23:10:11,799 DEBUG [RS:0;jenkins-hbase4:45387] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-18 23:10:11,799 DEBUG [RS:0;jenkins-hbase4:45387] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:11,799 DEBUG [RS:0;jenkins-hbase4:45387] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45387,1689721809516' 2023-07-18 23:10:11,799 DEBUG [RS:0;jenkins-hbase4:45387] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:10:11,799 DEBUG [RS:0;jenkins-hbase4:45387] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:10:11,800 DEBUG [RS:0;jenkins-hbase4:45387] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-18 23:10:11,800 INFO [RS:0;jenkins-hbase4:45387] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-18 23:10:11,800 INFO [RS:0;jenkins-hbase4:45387] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-18 23:10:11,806 INFO [RS:2;jenkins-hbase4:38625] regionserver.Replication(203): jenkins-hbase4.apache.org,38625,1689721809654 started 2023-07-18 23:10:11,806 INFO [RS:2;jenkins-hbase4:38625] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,38625,1689721809654, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38625, sessionid=0x1017ab3231c0003 2023-07-18 23:10:11,806 DEBUG [RS:2;jenkins-hbase4:38625] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-18 23:10:11,806 DEBUG [RS:2;jenkins-hbase4:38625] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:11,807 DEBUG [RS:2;jenkins-hbase4:38625] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38625,1689721809654' 2023-07-18 23:10:11,808 DEBUG [RS:2;jenkins-hbase4:38625] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-18 23:10:11,812 DEBUG [RS:2;jenkins-hbase4:38625] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-18 23:10:11,812 DEBUG [RS:2;jenkins-hbase4:38625] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-18 23:10:11,812 DEBUG [RS:2;jenkins-hbase4:38625] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-18 23:10:11,812 DEBUG [RS:2;jenkins-hbase4:38625] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:11,813 DEBUG [RS:2;jenkins-hbase4:38625] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38625,1689721809654' 2023-07-18 23:10:11,813 DEBUG [RS:2;jenkins-hbase4:38625] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:10:11,813 DEBUG [RS:2;jenkins-hbase4:38625] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:10:11,814 DEBUG [RS:2;jenkins-hbase4:38625] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-18 23:10:11,814 INFO [RS:2;jenkins-hbase4:38625] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-18 23:10:11,814 INFO [RS:2;jenkins-hbase4:38625] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-18 23:10:11,818 INFO [RS:1;jenkins-hbase4:45431] regionserver.Replication(203): jenkins-hbase4.apache.org,45431,1689721809599 started 2023-07-18 23:10:11,819 INFO [RS:1;jenkins-hbase4:45431] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,45431,1689721809599, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45431, sessionid=0x1017ab3231c0002 2023-07-18 23:10:11,819 DEBUG [RS:1;jenkins-hbase4:45431] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-18 23:10:11,819 DEBUG [RS:1;jenkins-hbase4:45431] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:11,819 DEBUG [RS:1;jenkins-hbase4:45431] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45431,1689721809599' 2023-07-18 23:10:11,819 DEBUG [RS:1;jenkins-hbase4:45431] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-18 23:10:11,819 DEBUG [RS:1;jenkins-hbase4:45431] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-18 23:10:11,820 DEBUG [RS:1;jenkins-hbase4:45431] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-18 23:10:11,820 DEBUG [RS:1;jenkins-hbase4:45431] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-18 23:10:11,820 DEBUG [RS:1;jenkins-hbase4:45431] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:11,820 DEBUG [RS:1;jenkins-hbase4:45431] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45431,1689721809599' 2023-07-18 23:10:11,820 DEBUG [RS:1;jenkins-hbase4:45431] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:10:11,820 DEBUG [RS:1;jenkins-hbase4:45431] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:10:11,821 DEBUG [RS:1;jenkins-hbase4:45431] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-18 23:10:11,821 INFO [RS:1;jenkins-hbase4:45431] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-18 23:10:11,821 INFO [RS:1;jenkins-hbase4:45431] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-18 23:10:11,843 DEBUG [jenkins-hbase4:46651] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-18 23:10:11,852 DEBUG [jenkins-hbase4:46651] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 23:10:11,861 DEBUG [jenkins-hbase4:46651] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 23:10:11,861 DEBUG [jenkins-hbase4:46651] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 23:10:11,861 DEBUG [jenkins-hbase4:46651] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 23:10:11,861 DEBUG [jenkins-hbase4:46651] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 23:10:11,866 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45387,1689721809516, state=OPENING 2023-07-18 23:10:11,876 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-18 23:10:11,878 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 23:10:11,879 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-18 23:10:11,883 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45387,1689721809516}] 2023-07-18 23:10:11,927 INFO [RS:1;jenkins-hbase4:45431] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45431%2C1689721809599, suffix=, logDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/WALs/jenkins-hbase4.apache.org,45431,1689721809599, archiveDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/oldWALs, maxLogs=32 2023-07-18 23:10:11,928 INFO [RS:2;jenkins-hbase4:38625] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38625%2C1689721809654, suffix=, logDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/WALs/jenkins-hbase4.apache.org,38625,1689721809654, archiveDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/oldWALs, maxLogs=32 2023-07-18 23:10:11,927 INFO [RS:0;jenkins-hbase4:45387] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45387%2C1689721809516, suffix=, logDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/WALs/jenkins-hbase4.apache.org,45387,1689721809516, archiveDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/oldWALs, maxLogs=32 2023-07-18 23:10:11,992 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46307,DS-83eeca1d-a46d-4502-af7c-48c1cd895106,DISK] 2023-07-18 23:10:11,992 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37649,DS-39467baa-8808-48d2-86a7-e09d3f43fb58,DISK] 2023-07-18 23:10:11,992 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46261,DS-e75af02c-9ee7-4992-b74d-e60bf3240642,DISK] 2023-07-18 23:10:12,002 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46307,DS-83eeca1d-a46d-4502-af7c-48c1cd895106,DISK] 2023-07-18 23:10:12,003 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46261,DS-e75af02c-9ee7-4992-b74d-e60bf3240642,DISK] 2023-07-18 23:10:12,004 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37649,DS-39467baa-8808-48d2-86a7-e09d3f43fb58,DISK] 2023-07-18 23:10:12,007 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37649,DS-39467baa-8808-48d2-86a7-e09d3f43fb58,DISK] 2023-07-18 23:10:12,007 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46307,DS-83eeca1d-a46d-4502-af7c-48c1cd895106,DISK] 2023-07-18 23:10:12,008 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46261,DS-e75af02c-9ee7-4992-b74d-e60bf3240642,DISK] 2023-07-18 23:10:12,027 INFO [RS:2;jenkins-hbase4:38625] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/WALs/jenkins-hbase4.apache.org,38625,1689721809654/jenkins-hbase4.apache.org%2C38625%2C1689721809654.1689721811934 2023-07-18 23:10:12,027 INFO [RS:1;jenkins-hbase4:45431] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/WALs/jenkins-hbase4.apache.org,45431,1689721809599/jenkins-hbase4.apache.org%2C45431%2C1689721809599.1689721811934 2023-07-18 23:10:12,028 INFO [RS:0;jenkins-hbase4:45387] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/WALs/jenkins-hbase4.apache.org,45387,1689721809516/jenkins-hbase4.apache.org%2C45387%2C1689721809516.1689721811936 2023-07-18 23:10:12,030 DEBUG [RS:2;jenkins-hbase4:38625] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46261,DS-e75af02c-9ee7-4992-b74d-e60bf3240642,DISK], DatanodeInfoWithStorage[127.0.0.1:46307,DS-83eeca1d-a46d-4502-af7c-48c1cd895106,DISK], DatanodeInfoWithStorage[127.0.0.1:37649,DS-39467baa-8808-48d2-86a7-e09d3f43fb58,DISK]] 2023-07-18 23:10:12,031 DEBUG [RS:0;jenkins-hbase4:45387] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46307,DS-83eeca1d-a46d-4502-af7c-48c1cd895106,DISK], DatanodeInfoWithStorage[127.0.0.1:37649,DS-39467baa-8808-48d2-86a7-e09d3f43fb58,DISK], DatanodeInfoWithStorage[127.0.0.1:46261,DS-e75af02c-9ee7-4992-b74d-e60bf3240642,DISK]] 2023-07-18 23:10:12,039 DEBUG [RS:1;jenkins-hbase4:45431] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46261,DS-e75af02c-9ee7-4992-b74d-e60bf3240642,DISK], DatanodeInfoWithStorage[127.0.0.1:46307,DS-83eeca1d-a46d-4502-af7c-48c1cd895106,DISK], DatanodeInfoWithStorage[127.0.0.1:37649,DS-39467baa-8808-48d2-86a7-e09d3f43fb58,DISK]] 2023-07-18 23:10:12,105 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:12,111 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-18 23:10:12,118 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56304, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-18 23:10:12,138 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-18 23:10:12,138 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-18 23:10:12,145 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45387%2C1689721809516.meta, suffix=.meta, logDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/WALs/jenkins-hbase4.apache.org,45387,1689721809516, archiveDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/oldWALs, maxLogs=32 2023-07-18 23:10:12,167 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46261,DS-e75af02c-9ee7-4992-b74d-e60bf3240642,DISK] 2023-07-18 23:10:12,171 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46307,DS-83eeca1d-a46d-4502-af7c-48c1cd895106,DISK] 2023-07-18 23:10:12,171 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37649,DS-39467baa-8808-48d2-86a7-e09d3f43fb58,DISK] 2023-07-18 23:10:12,180 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/WALs/jenkins-hbase4.apache.org,45387,1689721809516/jenkins-hbase4.apache.org%2C45387%2C1689721809516.meta.1689721812146.meta 2023-07-18 23:10:12,181 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46261,DS-e75af02c-9ee7-4992-b74d-e60bf3240642,DISK], DatanodeInfoWithStorage[127.0.0.1:46307,DS-83eeca1d-a46d-4502-af7c-48c1cd895106,DISK], DatanodeInfoWithStorage[127.0.0.1:37649,DS-39467baa-8808-48d2-86a7-e09d3f43fb58,DISK]] 2023-07-18 23:10:12,181 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-18 23:10:12,183 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-18 23:10:12,184 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 23:10:12,186 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-18 23:10:12,189 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-18 23:10:12,191 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-18 23:10:12,210 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-18 23:10:12,211 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 23:10:12,211 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-18 23:10:12,211 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-18 23:10:12,215 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-18 23:10:12,217 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/hbase/meta/1588230740/info 2023-07-18 23:10:12,217 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/hbase/meta/1588230740/info 2023-07-18 23:10:12,217 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-18 23:10:12,218 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 23:10:12,219 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-18 23:10:12,220 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/hbase/meta/1588230740/rep_barrier 2023-07-18 23:10:12,220 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/hbase/meta/1588230740/rep_barrier 2023-07-18 23:10:12,221 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-18 23:10:12,223 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 23:10:12,223 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-18 23:10:12,225 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/hbase/meta/1588230740/table 2023-07-18 23:10:12,225 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/hbase/meta/1588230740/table 2023-07-18 23:10:12,226 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-18 23:10:12,226 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 23:10:12,228 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/hbase/meta/1588230740 2023-07-18 23:10:12,233 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/hbase/meta/1588230740 2023-07-18 23:10:12,238 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-18 23:10:12,241 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-18 23:10:12,243 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59730840, jitterRate=-0.10994112491607666}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-18 23:10:12,247 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-18 23:10:12,260 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689721812093 2023-07-18 23:10:12,292 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-18 23:10:12,292 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-18 23:10:12,294 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45387,1689721809516, state=OPEN 2023-07-18 23:10:12,298 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-18 23:10:12,298 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-18 23:10:12,308 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-18 23:10:12,308 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45387,1689721809516 in 415 msec 2023-07-18 23:10:12,318 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-18 23:10:12,318 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 647 msec 2023-07-18 23:10:12,330 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.1650 sec 2023-07-18 23:10:12,330 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689721812330, completionTime=-1 2023-07-18 23:10:12,331 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-18 23:10:12,331 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-18 23:10:12,417 DEBUG [hconnection-0x32c52efa-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 23:10:12,420 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56312, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 23:10:12,442 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-18 23:10:12,442 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689721872442 2023-07-18 23:10:12,442 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689721932442 2023-07-18 23:10:12,442 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 111 msec 2023-07-18 23:10:12,471 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46651,1689721807857-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 23:10:12,471 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46651,1689721807857-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-18 23:10:12,471 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46651,1689721807857-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-18 23:10:12,474 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:46651, period=300000, unit=MILLISECONDS is enabled. 2023-07-18 23:10:12,475 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-18 23:10:12,483 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-18 23:10:12,494 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-18 23:10:12,495 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-18 23:10:12,509 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-18 23:10:12,513 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 23:10:12,518 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 23:10:12,547 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/hbase/namespace/223a7e9433605c67093dc1c37dd2dbc5 2023-07-18 23:10:12,551 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/hbase/namespace/223a7e9433605c67093dc1c37dd2dbc5 empty. 2023-07-18 23:10:12,551 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/hbase/namespace/223a7e9433605c67093dc1c37dd2dbc5 2023-07-18 23:10:12,552 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-18 23:10:12,613 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-18 23:10:12,616 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 223a7e9433605c67093dc1c37dd2dbc5, NAME => 'hbase:namespace,,1689721812495.223a7e9433605c67093dc1c37dd2dbc5.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp 2023-07-18 23:10:12,650 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689721812495.223a7e9433605c67093dc1c37dd2dbc5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 23:10:12,651 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 223a7e9433605c67093dc1c37dd2dbc5, disabling compactions & flushes 2023-07-18 23:10:12,651 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689721812495.223a7e9433605c67093dc1c37dd2dbc5. 2023-07-18 23:10:12,651 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689721812495.223a7e9433605c67093dc1c37dd2dbc5. 2023-07-18 23:10:12,651 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689721812495.223a7e9433605c67093dc1c37dd2dbc5. after waiting 0 ms 2023-07-18 23:10:12,651 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689721812495.223a7e9433605c67093dc1c37dd2dbc5. 2023-07-18 23:10:12,651 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689721812495.223a7e9433605c67093dc1c37dd2dbc5. 2023-07-18 23:10:12,651 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 223a7e9433605c67093dc1c37dd2dbc5: 2023-07-18 23:10:12,658 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 23:10:12,674 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689721812495.223a7e9433605c67093dc1c37dd2dbc5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689721812662"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689721812662"}]},"ts":"1689721812662"} 2023-07-18 23:10:12,712 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-18 23:10:12,714 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 23:10:12,718 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689721812714"}]},"ts":"1689721812714"} 2023-07-18 23:10:12,723 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-18 23:10:12,729 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 23:10:12,730 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 23:10:12,731 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 23:10:12,731 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 23:10:12,731 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 23:10:12,734 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=223a7e9433605c67093dc1c37dd2dbc5, ASSIGN}] 2023-07-18 23:10:12,737 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=223a7e9433605c67093dc1c37dd2dbc5, ASSIGN 2023-07-18 23:10:12,739 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=223a7e9433605c67093dc1c37dd2dbc5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45431,1689721809599; forceNewPlan=false, retain=false 2023-07-18 23:10:12,891 INFO [jenkins-hbase4:46651] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-18 23:10:12,892 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=223a7e9433605c67093dc1c37dd2dbc5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:12,893 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689721812495.223a7e9433605c67093dc1c37dd2dbc5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689721812892"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689721812892"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689721812892"}]},"ts":"1689721812892"} 2023-07-18 23:10:12,898 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 223a7e9433605c67093dc1c37dd2dbc5, server=jenkins-hbase4.apache.org,45431,1689721809599}] 2023-07-18 23:10:13,059 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:13,059 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-18 23:10:13,063 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58204, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-18 23:10:13,070 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689721812495.223a7e9433605c67093dc1c37dd2dbc5. 2023-07-18 23:10:13,071 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 223a7e9433605c67093dc1c37dd2dbc5, NAME => 'hbase:namespace,,1689721812495.223a7e9433605c67093dc1c37dd2dbc5.', STARTKEY => '', ENDKEY => ''} 2023-07-18 23:10:13,071 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689721812495.223a7e9433605c67093dc1c37dd2dbc5. service=AccessControlService 2023-07-18 23:10:13,072 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 23:10:13,072 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 223a7e9433605c67093dc1c37dd2dbc5 2023-07-18 23:10:13,072 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689721812495.223a7e9433605c67093dc1c37dd2dbc5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 23:10:13,072 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 223a7e9433605c67093dc1c37dd2dbc5 2023-07-18 23:10:13,072 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 223a7e9433605c67093dc1c37dd2dbc5 2023-07-18 23:10:13,075 INFO [StoreOpener-223a7e9433605c67093dc1c37dd2dbc5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 223a7e9433605c67093dc1c37dd2dbc5 2023-07-18 23:10:13,077 DEBUG [StoreOpener-223a7e9433605c67093dc1c37dd2dbc5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/hbase/namespace/223a7e9433605c67093dc1c37dd2dbc5/info 2023-07-18 23:10:13,077 DEBUG [StoreOpener-223a7e9433605c67093dc1c37dd2dbc5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/hbase/namespace/223a7e9433605c67093dc1c37dd2dbc5/info 2023-07-18 23:10:13,077 INFO [StoreOpener-223a7e9433605c67093dc1c37dd2dbc5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 223a7e9433605c67093dc1c37dd2dbc5 columnFamilyName info 2023-07-18 23:10:13,079 INFO [StoreOpener-223a7e9433605c67093dc1c37dd2dbc5-1] regionserver.HStore(310): Store=223a7e9433605c67093dc1c37dd2dbc5/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 23:10:13,081 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/hbase/namespace/223a7e9433605c67093dc1c37dd2dbc5 2023-07-18 23:10:13,081 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/hbase/namespace/223a7e9433605c67093dc1c37dd2dbc5 2023-07-18 23:10:13,085 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 223a7e9433605c67093dc1c37dd2dbc5 2023-07-18 23:10:13,089 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/hbase/namespace/223a7e9433605c67093dc1c37dd2dbc5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 23:10:13,090 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 223a7e9433605c67093dc1c37dd2dbc5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74678732, jitterRate=0.11279982328414917}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 23:10:13,090 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 223a7e9433605c67093dc1c37dd2dbc5: 2023-07-18 23:10:13,092 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689721812495.223a7e9433605c67093dc1c37dd2dbc5., pid=6, masterSystemTime=1689721813059 2023-07-18 23:10:13,096 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689721812495.223a7e9433605c67093dc1c37dd2dbc5. 2023-07-18 23:10:13,097 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689721812495.223a7e9433605c67093dc1c37dd2dbc5. 2023-07-18 23:10:13,098 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=223a7e9433605c67093dc1c37dd2dbc5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:13,098 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689721812495.223a7e9433605c67093dc1c37dd2dbc5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689721813097"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689721813097"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689721813097"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689721813097"}]},"ts":"1689721813097"} 2023-07-18 23:10:13,106 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-18 23:10:13,106 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 223a7e9433605c67093dc1c37dd2dbc5, server=jenkins-hbase4.apache.org,45431,1689721809599 in 205 msec 2023-07-18 23:10:13,110 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-18 23:10:13,111 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=223a7e9433605c67093dc1c37dd2dbc5, ASSIGN in 372 msec 2023-07-18 23:10:13,112 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 23:10:13,112 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689721813112"}]},"ts":"1689721813112"} 2023-07-18 23:10:13,114 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-18 23:10:13,117 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 23:10:13,120 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 621 msec 2023-07-18 23:10:13,212 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-18 23:10:13,214 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-18 23:10:13,214 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 23:10:13,236 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 23:10:13,238 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58212, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 23:10:13,254 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-18 23:10:13,269 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-18 23:10:13,276 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 31 msec 2023-07-18 23:10:13,287 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-18 23:10:13,298 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-18 23:10:13,303 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 15 msec 2023-07-18 23:10:13,314 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-18 23:10:13,316 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-18 23:10:13,317 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.572sec 2023-07-18 23:10:13,320 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-18 23:10:13,321 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-18 23:10:13,321 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-18 23:10:13,323 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46651,1689721807857-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-18 23:10:13,324 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46651,1689721807857-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-18 23:10:13,343 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-18 23:10:13,345 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-18 23:10:13,347 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 23:10:13,349 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 23:10:13,351 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-18 23:10:13,351 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/hbase/acl/82c0ae918e241fa463d9d693b29481c7 2023-07-18 23:10:13,352 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/hbase/acl/82c0ae918e241fa463d9d693b29481c7 empty. 2023-07-18 23:10:13,355 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/hbase/acl/82c0ae918e241fa463d9d693b29481c7 2023-07-18 23:10:13,355 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-18 23:10:13,361 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-18 23:10:13,382 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-18 23:10:13,384 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 82c0ae918e241fa463d9d693b29481c7, NAME => 'hbase:acl,,1689721813339.82c0ae918e241fa463d9d693b29481c7.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp 2023-07-18 23:10:13,406 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689721813339.82c0ae918e241fa463d9d693b29481c7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 23:10:13,406 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 82c0ae918e241fa463d9d693b29481c7, disabling compactions & flushes 2023-07-18 23:10:13,406 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689721813339.82c0ae918e241fa463d9d693b29481c7. 2023-07-18 23:10:13,406 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689721813339.82c0ae918e241fa463d9d693b29481c7. 2023-07-18 23:10:13,406 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689721813339.82c0ae918e241fa463d9d693b29481c7. after waiting 0 ms 2023-07-18 23:10:13,406 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689721813339.82c0ae918e241fa463d9d693b29481c7. 2023-07-18 23:10:13,406 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689721813339.82c0ae918e241fa463d9d693b29481c7. 2023-07-18 23:10:13,406 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 82c0ae918e241fa463d9d693b29481c7: 2023-07-18 23:10:13,411 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 23:10:13,413 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689721813339.82c0ae918e241fa463d9d693b29481c7.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689721813413"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689721813413"}]},"ts":"1689721813413"} 2023-07-18 23:10:13,416 ERROR [Listener at localhost/42081] master.TableStateManager(95): Unable to get table hbase:acl state org.apache.hadoop.hbase.TableNotFoundException: No state found for hbase:acl at org.apache.hadoop.hbase.master.TableStateManager.getTableState(TableStateManager.java:155) at org.apache.hadoop.hbase.master.TableStateManager.isTableState(TableStateManager.java:92) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.isTableDisabled(AssignmentManager.java:419) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.getRegionStatesCount(AssignmentManager.java:2341) at org.apache.hadoop.hbase.master.HMaster.getClusterMetricsWithoutCoprocessor(HMaster.java:2616) at org.apache.hadoop.hbase.master.HMaster.getClusterMetrics(HMaster.java:2640) at org.apache.hadoop.hbase.master.HMaster.getClusterMetrics(HMaster.java:2633) at org.apache.hadoop.hbase.MiniHBaseCluster.getClusterMetrics(MiniHBaseCluster.java:710) at org.apache.hadoop.hbase.MiniHBaseCluster.(MiniHBaseCluster.java:111) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniHBaseCluster(HBaseTestingUtility.java:1131) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:1094) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:1048) at org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot.setUpBeforeClass(TestSecureExportSnapshot.java:55) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.RunBefores.invokeMethod(RunBefores.java:33) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) 2023-07-18 23:10:13,417 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-18 23:10:13,420 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 23:10:13,420 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689721813420"}]},"ts":"1689721813420"} 2023-07-18 23:10:13,422 DEBUG [Listener at localhost/42081] zookeeper.ReadOnlyZKClient(139): Connect 0x3c45df17 to 127.0.0.1:61306 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 23:10:13,422 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-18 23:10:13,435 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 23:10:13,435 DEBUG [Listener at localhost/42081] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@25818eae, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 23:10:13,436 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 23:10:13,436 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 23:10:13,436 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 23:10:13,436 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 23:10:13,436 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=82c0ae918e241fa463d9d693b29481c7, ASSIGN}] 2023-07-18 23:10:13,440 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=82c0ae918e241fa463d9d693b29481c7, ASSIGN 2023-07-18 23:10:13,442 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=82c0ae918e241fa463d9d693b29481c7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45387,1689721809516; forceNewPlan=false, retain=false 2023-07-18 23:10:13,452 DEBUG [hconnection-0x4056dd59-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 23:10:13,465 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-18 23:10:13,467 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56322, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 23:10:13,470 INFO [Listener at localhost/42081] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,46651,1689721807857 2023-07-18 23:10:13,470 INFO [Listener at localhost/42081] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-18 23:10:13,471 INFO [Listener at localhost/42081] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/test.cache.data in system properties and HBase conf 2023-07-18 23:10:13,471 INFO [Listener at localhost/42081] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/hadoop.tmp.dir in system properties and HBase conf 2023-07-18 23:10:13,471 INFO [Listener at localhost/42081] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/hadoop.log.dir in system properties and HBase conf 2023-07-18 23:10:13,471 INFO [Listener at localhost/42081] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-18 23:10:13,471 INFO [Listener at localhost/42081] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-18 23:10:13,471 INFO [Listener at localhost/42081] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-18 23:10:13,471 INFO [Listener at localhost/42081] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-18 23:10:13,472 INFO [Listener at localhost/42081] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-18 23:10:13,472 INFO [Listener at localhost/42081] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-18 23:10:13,472 INFO [Listener at localhost/42081] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-18 23:10:13,472 INFO [Listener at localhost/42081] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-18 23:10:13,472 INFO [Listener at localhost/42081] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-18 23:10:13,472 INFO [Listener at localhost/42081] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-18 23:10:13,472 INFO [Listener at localhost/42081] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-18 23:10:13,472 INFO [Listener at localhost/42081] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-18 23:10:13,473 INFO [Listener at localhost/42081] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/nfs.dump.dir in system properties and HBase conf 2023-07-18 23:10:13,473 INFO [Listener at localhost/42081] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/java.io.tmpdir in system properties and HBase conf 2023-07-18 23:10:13,473 INFO [Listener at localhost/42081] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-18 23:10:13,473 INFO [Listener at localhost/42081] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-18 23:10:13,473 INFO [Listener at localhost/42081] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-18 23:10:13,593 INFO [jenkins-hbase4:46651] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-18 23:10:13,595 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=82c0ae918e241fa463d9d693b29481c7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:13,596 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689721813339.82c0ae918e241fa463d9d693b29481c7.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689721813594"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689721813594"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689721813594"}]},"ts":"1689721813594"} 2023-07-18 23:10:13,609 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 82c0ae918e241fa463d9d693b29481c7, server=jenkins-hbase4.apache.org,45387,1689721809516}] 2023-07-18 23:10:13,666 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-18 23:10:13,771 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689721813339.82c0ae918e241fa463d9d693b29481c7. 2023-07-18 23:10:13,772 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 82c0ae918e241fa463d9d693b29481c7, NAME => 'hbase:acl,,1689721813339.82c0ae918e241fa463d9d693b29481c7.', STARTKEY => '', ENDKEY => ''} 2023-07-18 23:10:13,772 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689721813339.82c0ae918e241fa463d9d693b29481c7. service=AccessControlService 2023-07-18 23:10:13,772 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 23:10:13,772 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 82c0ae918e241fa463d9d693b29481c7 2023-07-18 23:10:13,773 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689721813339.82c0ae918e241fa463d9d693b29481c7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 23:10:13,773 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 82c0ae918e241fa463d9d693b29481c7 2023-07-18 23:10:13,773 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 82c0ae918e241fa463d9d693b29481c7 2023-07-18 23:10:13,783 INFO [StoreOpener-82c0ae918e241fa463d9d693b29481c7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 82c0ae918e241fa463d9d693b29481c7 2023-07-18 23:10:13,787 DEBUG [StoreOpener-82c0ae918e241fa463d9d693b29481c7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/hbase/acl/82c0ae918e241fa463d9d693b29481c7/l 2023-07-18 23:10:13,787 DEBUG [StoreOpener-82c0ae918e241fa463d9d693b29481c7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/hbase/acl/82c0ae918e241fa463d9d693b29481c7/l 2023-07-18 23:10:13,788 INFO [StoreOpener-82c0ae918e241fa463d9d693b29481c7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 82c0ae918e241fa463d9d693b29481c7 columnFamilyName l 2023-07-18 23:10:13,790 INFO [StoreOpener-82c0ae918e241fa463d9d693b29481c7-1] regionserver.HStore(310): Store=82c0ae918e241fa463d9d693b29481c7/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 23:10:13,800 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/hbase/acl/82c0ae918e241fa463d9d693b29481c7 2023-07-18 23:10:13,801 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/hbase/acl/82c0ae918e241fa463d9d693b29481c7 2023-07-18 23:10:13,806 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 82c0ae918e241fa463d9d693b29481c7 2023-07-18 23:10:13,812 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/hbase/acl/82c0ae918e241fa463d9d693b29481c7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 23:10:13,813 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 82c0ae918e241fa463d9d693b29481c7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63841950, jitterRate=-0.04868081212043762}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 23:10:13,814 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 82c0ae918e241fa463d9d693b29481c7: 2023-07-18 23:10:13,821 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689721813339.82c0ae918e241fa463d9d693b29481c7., pid=11, masterSystemTime=1689721813764 2023-07-18 23:10:13,829 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689721813339.82c0ae918e241fa463d9d693b29481c7. 2023-07-18 23:10:13,829 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689721813339.82c0ae918e241fa463d9d693b29481c7. 2023-07-18 23:10:13,830 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=82c0ae918e241fa463d9d693b29481c7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:13,830 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689721813339.82c0ae918e241fa463d9d693b29481c7.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689721813830"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689721813830"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689721813830"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689721813830"}]},"ts":"1689721813830"} 2023-07-18 23:10:13,837 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-18 23:10:13,837 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 82c0ae918e241fa463d9d693b29481c7, server=jenkins-hbase4.apache.org,45387,1689721809516 in 224 msec 2023-07-18 23:10:13,841 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-18 23:10:13,841 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=82c0ae918e241fa463d9d693b29481c7, ASSIGN in 401 msec 2023-07-18 23:10:13,843 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 23:10:13,843 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689721813843"}]},"ts":"1689721813843"} 2023-07-18 23:10:13,845 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-18 23:10:13,849 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 23:10:13,854 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 505 msec 2023-07-18 23:10:13,966 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-18 23:10:13,966 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-18 23:10:13,980 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-18 23:10:14,990 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 23:10:15,393 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 23:10:15,402 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_46641_jobhistory____8vxbyy/webapp 2023-07-18 23:10:15,598 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-18 23:10:15,598 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-18 23:10:15,598 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-18 23:10:15,603 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-18 23:10:15,718 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 23:10:16,194 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 23:10:16,575 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-18 23:10:16,659 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:46641 2023-07-18 23:10:17,766 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 23:10:17,991 WARN [Listener at jenkins-hbase4.apache.org/42463] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 23:10:18,027 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-18 23:10:18,029 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-18 23:10:18,030 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-18 23:10:18,054 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 23:10:18,054 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-18 23:10:18,055 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 23:10:18,055 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-18 23:10:18,055 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-18 23:10:18,055 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-18 23:10:18,055 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 23:10:18,055 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-18 23:10:18,056 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-18 23:10:18,056 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-18 23:10:18,102 WARN [Listener at jenkins-hbase4.apache.org/42463] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-18 23:10:18,102 INFO [Listener at jenkins-hbase4.apache.org/42463] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 23:10:18,110 INFO [Listener at jenkins-hbase4.apache.org/42463] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_40203_cluster____rk1idn/webapp 2023-07-18 23:10:18,188 INFO [Listener at jenkins-hbase4.apache.org/42463] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-18 23:10:18,189 INFO [Listener at jenkins-hbase4.apache.org/42463] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-18 23:10:18,189 INFO [Listener at jenkins-hbase4.apache.org/42463] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-18 23:10:18,189 INFO [Listener at jenkins-hbase4.apache.org/42463] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-18 23:10:18,202 INFO [Listener at jenkins-hbase4.apache.org/42463] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 23:10:18,470 INFO [Listener at jenkins-hbase4.apache.org/42463] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 23:10:18,588 INFO [Listener at jenkins-hbase4.apache.org/42463] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 23:10:18,594 INFO [Listener at jenkins-hbase4.apache.org/42463] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:40203 2023-07-18 23:10:19,230 WARN [Listener at jenkins-hbase4.apache.org/45611] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 23:10:19,261 WARN [Listener at jenkins-hbase4.apache.org/45611] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-18 23:10:19,261 INFO [Listener at jenkins-hbase4.apache.org/45611] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 23:10:19,273 INFO [Listener at jenkins-hbase4.apache.org/45611] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_39917_node____h4zz1z/webapp 2023-07-18 23:10:19,327 INFO [Listener at jenkins-hbase4.apache.org/45611] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-18 23:10:19,327 INFO [Listener at jenkins-hbase4.apache.org/45611] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-18 23:10:19,327 INFO [Listener at jenkins-hbase4.apache.org/45611] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-18 23:10:19,327 INFO [Listener at jenkins-hbase4.apache.org/45611] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-18 23:10:19,336 INFO [Listener at jenkins-hbase4.apache.org/45611] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 23:10:19,362 INFO [Listener at jenkins-hbase4.apache.org/45611] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 23:10:19,462 INFO [Listener at jenkins-hbase4.apache.org/45611] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 23:10:19,476 INFO [Listener at jenkins-hbase4.apache.org/45611] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:39917 2023-07-18 23:10:19,761 WARN [Listener at jenkins-hbase4.apache.org/33217] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 23:10:19,769 WARN [Listener at jenkins-hbase4.apache.org/33217] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-18 23:10:19,770 INFO [Listener at jenkins-hbase4.apache.org/33217] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 23:10:19,780 INFO [Listener at jenkins-hbase4.apache.org/33217] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_35877_node____itgbec/webapp 2023-07-18 23:10:19,850 INFO [Listener at jenkins-hbase4.apache.org/33217] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-18 23:10:19,850 INFO [Listener at jenkins-hbase4.apache.org/33217] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-18 23:10:19,850 INFO [Listener at jenkins-hbase4.apache.org/33217] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-18 23:10:19,850 INFO [Listener at jenkins-hbase4.apache.org/33217] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-18 23:10:19,859 INFO [Listener at jenkins-hbase4.apache.org/33217] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 23:10:19,883 INFO [Listener at jenkins-hbase4.apache.org/33217] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 23:10:19,979 INFO [Listener at jenkins-hbase4.apache.org/33217] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 23:10:20,003 INFO [Listener at jenkins-hbase4.apache.org/33217] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:35877 2023-07-18 23:10:20,036 INFO [Listener at jenkins-hbase4.apache.org/33217] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-18 23:10:20,038 INFO [Listener at jenkins-hbase4.apache.org/33217] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 23:10:20,112 INFO [Listener at jenkins-hbase4.apache.org/33217] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=709, OpenFileDescriptor=896, MaxFileDescriptor=60000, SystemLoadAverage=429, ProcessCount=177, AvailableMemoryMB=4525 2023-07-18 23:10:20,112 WARN [Listener at jenkins-hbase4.apache.org/33217] hbase.ResourceChecker(130): Thread=709 is superior to 500 2023-07-18 23:10:20,134 DEBUG [Listener at jenkins-hbase4.apache.org/33217] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-18 23:10:20,143 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53258, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-18 23:10:20,151 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-18 23:10:20,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-18 23:10:20,159 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 23:10:20,160 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-18 23:10:20,161 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 23:10:20,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-18 23:10:20,171 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportWithTargetName/9d2a3d19522e3d381f93366b0e9cc340 2023-07-18 23:10:20,171 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportWithTargetName/91442dc89ad96cfd02c0d091962a3305 2023-07-18 23:10:20,173 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportWithTargetName/9d2a3d19522e3d381f93366b0e9cc340 empty. 2023-07-18 23:10:20,173 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportWithTargetName/91442dc89ad96cfd02c0d091962a3305 empty. 2023-07-18 23:10:20,174 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportWithTargetName/9d2a3d19522e3d381f93366b0e9cc340 2023-07-18 23:10:20,174 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportWithTargetName/91442dc89ad96cfd02c0d091962a3305 2023-07-18 23:10:20,175 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-18 23:10:20,206 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-18 23:10:20,208 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9d2a3d19522e3d381f93366b0e9cc340, NAME => 'testtb-testExportWithTargetName,,1689721820151.9d2a3d19522e3d381f93366b0e9cc340.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp 2023-07-18 23:10:20,208 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 91442dc89ad96cfd02c0d091962a3305, NAME => 'testtb-testExportWithTargetName,1,1689721820151.91442dc89ad96cfd02c0d091962a3305.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp 2023-07-18 23:10:20,263 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689721820151.91442dc89ad96cfd02c0d091962a3305.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 23:10:20,263 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 91442dc89ad96cfd02c0d091962a3305, disabling compactions & flushes 2023-07-18 23:10:20,263 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689721820151.91442dc89ad96cfd02c0d091962a3305. 2023-07-18 23:10:20,263 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689721820151.91442dc89ad96cfd02c0d091962a3305. 2023-07-18 23:10:20,263 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689721820151.91442dc89ad96cfd02c0d091962a3305. after waiting 0 ms 2023-07-18 23:10:20,263 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689721820151.91442dc89ad96cfd02c0d091962a3305. 2023-07-18 23:10:20,263 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689721820151.91442dc89ad96cfd02c0d091962a3305. 2023-07-18 23:10:20,263 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 91442dc89ad96cfd02c0d091962a3305: 2023-07-18 23:10:20,264 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689721820151.9d2a3d19522e3d381f93366b0e9cc340.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 23:10:20,264 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 9d2a3d19522e3d381f93366b0e9cc340, disabling compactions & flushes 2023-07-18 23:10:20,265 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689721820151.9d2a3d19522e3d381f93366b0e9cc340. 2023-07-18 23:10:20,265 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689721820151.9d2a3d19522e3d381f93366b0e9cc340. 2023-07-18 23:10:20,265 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689721820151.9d2a3d19522e3d381f93366b0e9cc340. after waiting 0 ms 2023-07-18 23:10:20,265 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689721820151.9d2a3d19522e3d381f93366b0e9cc340. 2023-07-18 23:10:20,265 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689721820151.9d2a3d19522e3d381f93366b0e9cc340. 2023-07-18 23:10:20,265 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 9d2a3d19522e3d381f93366b0e9cc340: 2023-07-18 23:10:20,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-18 23:10:20,269 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 23:10:20,271 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689721820151.91442dc89ad96cfd02c0d091962a3305.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689721820271"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689721820271"}]},"ts":"1689721820271"} 2023-07-18 23:10:20,271 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689721820151.9d2a3d19522e3d381f93366b0e9cc340.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689721820271"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689721820271"}]},"ts":"1689721820271"} 2023-07-18 23:10:20,327 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-18 23:10:20,328 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 23:10:20,329 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689721820329"}]},"ts":"1689721820329"} 2023-07-18 23:10:20,331 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-18 23:10:20,338 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 23:10:20,344 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 23:10:20,344 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 23:10:20,344 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 23:10:20,344 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 23:10:20,344 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9d2a3d19522e3d381f93366b0e9cc340, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=91442dc89ad96cfd02c0d091962a3305, ASSIGN}] 2023-07-18 23:10:20,348 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9d2a3d19522e3d381f93366b0e9cc340, ASSIGN 2023-07-18 23:10:20,348 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=91442dc89ad96cfd02c0d091962a3305, ASSIGN 2023-07-18 23:10:20,350 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=91442dc89ad96cfd02c0d091962a3305, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45387,1689721809516; forceNewPlan=false, retain=false 2023-07-18 23:10:20,350 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9d2a3d19522e3d381f93366b0e9cc340, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45431,1689721809599; forceNewPlan=false, retain=false 2023-07-18 23:10:20,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-18 23:10:20,500 INFO [jenkins-hbase4:46651] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-18 23:10:20,503 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=91442dc89ad96cfd02c0d091962a3305, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:20,503 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=9d2a3d19522e3d381f93366b0e9cc340, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:20,504 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689721820151.91442dc89ad96cfd02c0d091962a3305.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689721820503"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689721820503"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689721820503"}]},"ts":"1689721820503"} 2023-07-18 23:10:20,504 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689721820151.9d2a3d19522e3d381f93366b0e9cc340.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689721820503"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689721820503"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689721820503"}]},"ts":"1689721820503"} 2023-07-18 23:10:20,507 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 91442dc89ad96cfd02c0d091962a3305, server=jenkins-hbase4.apache.org,45387,1689721809516}] 2023-07-18 23:10:20,509 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 9d2a3d19522e3d381f93366b0e9cc340, server=jenkins-hbase4.apache.org,45431,1689721809599}] 2023-07-18 23:10:20,668 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689721820151.91442dc89ad96cfd02c0d091962a3305. 2023-07-18 23:10:20,668 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689721820151.9d2a3d19522e3d381f93366b0e9cc340. 2023-07-18 23:10:20,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 91442dc89ad96cfd02c0d091962a3305, NAME => 'testtb-testExportWithTargetName,1,1689721820151.91442dc89ad96cfd02c0d091962a3305.', STARTKEY => '1', ENDKEY => ''} 2023-07-18 23:10:20,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9d2a3d19522e3d381f93366b0e9cc340, NAME => 'testtb-testExportWithTargetName,,1689721820151.9d2a3d19522e3d381f93366b0e9cc340.', STARTKEY => '', ENDKEY => '1'} 2023-07-18 23:10:20,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689721820151.91442dc89ad96cfd02c0d091962a3305. service=AccessControlService 2023-07-18 23:10:20,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689721820151.9d2a3d19522e3d381f93366b0e9cc340. service=AccessControlService 2023-07-18 23:10:20,669 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 23:10:20,669 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 23:10:20,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 91442dc89ad96cfd02c0d091962a3305 2023-07-18 23:10:20,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 9d2a3d19522e3d381f93366b0e9cc340 2023-07-18 23:10:20,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689721820151.91442dc89ad96cfd02c0d091962a3305.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 23:10:20,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689721820151.9d2a3d19522e3d381f93366b0e9cc340.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 23:10:20,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 91442dc89ad96cfd02c0d091962a3305 2023-07-18 23:10:20,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9d2a3d19522e3d381f93366b0e9cc340 2023-07-18 23:10:20,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 91442dc89ad96cfd02c0d091962a3305 2023-07-18 23:10:20,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9d2a3d19522e3d381f93366b0e9cc340 2023-07-18 23:10:20,672 INFO [StoreOpener-91442dc89ad96cfd02c0d091962a3305-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 91442dc89ad96cfd02c0d091962a3305 2023-07-18 23:10:20,672 INFO [StoreOpener-9d2a3d19522e3d381f93366b0e9cc340-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9d2a3d19522e3d381f93366b0e9cc340 2023-07-18 23:10:20,674 DEBUG [StoreOpener-91442dc89ad96cfd02c0d091962a3305-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportWithTargetName/91442dc89ad96cfd02c0d091962a3305/cf 2023-07-18 23:10:20,674 DEBUG [StoreOpener-91442dc89ad96cfd02c0d091962a3305-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportWithTargetName/91442dc89ad96cfd02c0d091962a3305/cf 2023-07-18 23:10:20,674 DEBUG [StoreOpener-9d2a3d19522e3d381f93366b0e9cc340-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportWithTargetName/9d2a3d19522e3d381f93366b0e9cc340/cf 2023-07-18 23:10:20,674 DEBUG [StoreOpener-9d2a3d19522e3d381f93366b0e9cc340-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportWithTargetName/9d2a3d19522e3d381f93366b0e9cc340/cf 2023-07-18 23:10:20,675 INFO [StoreOpener-91442dc89ad96cfd02c0d091962a3305-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 91442dc89ad96cfd02c0d091962a3305 columnFamilyName cf 2023-07-18 23:10:20,675 INFO [StoreOpener-9d2a3d19522e3d381f93366b0e9cc340-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9d2a3d19522e3d381f93366b0e9cc340 columnFamilyName cf 2023-07-18 23:10:20,675 INFO [StoreOpener-91442dc89ad96cfd02c0d091962a3305-1] regionserver.HStore(310): Store=91442dc89ad96cfd02c0d091962a3305/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 23:10:20,677 INFO [StoreOpener-9d2a3d19522e3d381f93366b0e9cc340-1] regionserver.HStore(310): Store=9d2a3d19522e3d381f93366b0e9cc340/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 23:10:20,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportWithTargetName/91442dc89ad96cfd02c0d091962a3305 2023-07-18 23:10:20,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportWithTargetName/9d2a3d19522e3d381f93366b0e9cc340 2023-07-18 23:10:20,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportWithTargetName/91442dc89ad96cfd02c0d091962a3305 2023-07-18 23:10:20,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportWithTargetName/9d2a3d19522e3d381f93366b0e9cc340 2023-07-18 23:10:20,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 91442dc89ad96cfd02c0d091962a3305 2023-07-18 23:10:20,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9d2a3d19522e3d381f93366b0e9cc340 2023-07-18 23:10:20,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportWithTargetName/91442dc89ad96cfd02c0d091962a3305/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 23:10:20,693 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 91442dc89ad96cfd02c0d091962a3305; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72540922, jitterRate=0.08094397187232971}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 23:10:20,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportWithTargetName/9d2a3d19522e3d381f93366b0e9cc340/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 23:10:20,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 91442dc89ad96cfd02c0d091962a3305: 2023-07-18 23:10:20,694 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9d2a3d19522e3d381f93366b0e9cc340; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64084853, jitterRate=-0.045061275362968445}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 23:10:20,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9d2a3d19522e3d381f93366b0e9cc340: 2023-07-18 23:10:20,697 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689721820151.91442dc89ad96cfd02c0d091962a3305., pid=15, masterSystemTime=1689721820662 2023-07-18 23:10:20,697 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689721820151.9d2a3d19522e3d381f93366b0e9cc340., pid=16, masterSystemTime=1689721820662 2023-07-18 23:10:20,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689721820151.91442dc89ad96cfd02c0d091962a3305. 2023-07-18 23:10:20,699 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689721820151.91442dc89ad96cfd02c0d091962a3305. 2023-07-18 23:10:20,700 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=91442dc89ad96cfd02c0d091962a3305, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:20,701 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689721820151.91442dc89ad96cfd02c0d091962a3305.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689721820700"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689721820700"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689721820700"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689721820700"}]},"ts":"1689721820700"} 2023-07-18 23:10:20,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689721820151.9d2a3d19522e3d381f93366b0e9cc340. 2023-07-18 23:10:20,701 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689721820151.9d2a3d19522e3d381f93366b0e9cc340. 2023-07-18 23:10:20,702 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=9d2a3d19522e3d381f93366b0e9cc340, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:20,703 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689721820151.9d2a3d19522e3d381f93366b0e9cc340.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689721820702"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689721820702"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689721820702"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689721820702"}]},"ts":"1689721820702"} 2023-07-18 23:10:20,708 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-18 23:10:20,708 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 91442dc89ad96cfd02c0d091962a3305, server=jenkins-hbase4.apache.org,45387,1689721809516 in 197 msec 2023-07-18 23:10:20,710 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-18 23:10:20,713 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 9d2a3d19522e3d381f93366b0e9cc340, server=jenkins-hbase4.apache.org,45431,1689721809599 in 197 msec 2023-07-18 23:10:20,714 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=91442dc89ad96cfd02c0d091962a3305, ASSIGN in 364 msec 2023-07-18 23:10:20,717 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-18 23:10:20,717 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9d2a3d19522e3d381f93366b0e9cc340, ASSIGN in 369 msec 2023-07-18 23:10:20,718 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 23:10:20,718 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689721820718"}]},"ts":"1689721820718"} 2023-07-18 23:10:20,720 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-18 23:10:20,723 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 23:10:20,728 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-18 23:10:20,744 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45387] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-18 23:10:20,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-18 23:10:20,777 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-18 23:10:20,777 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-18 23:10:20,777 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 23:10:20,777 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-18 23:10:20,778 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-18 23:10:20,804 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-18 23:10:20,804 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-18 23:10:20,804 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-18 23:10:20,804 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-18 23:10:20,808 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-18 23:10:20,810 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 655 msec 2023-07-18 23:10:21,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-18 23:10:21,276 INFO [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-18 23:10:21,276 DEBUG [Listener at jenkins-hbase4.apache.org/33217] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportWithTargetName get assigned. Timeout = 60000ms 2023-07-18 23:10:21,277 INFO [Listener at jenkins-hbase4.apache.org/33217] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 23:10:21,282 INFO [Listener at jenkins-hbase4.apache.org/33217] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportWithTargetName assigned to meta. Checking AM states. 2023-07-18 23:10:21,283 INFO [Listener at jenkins-hbase4.apache.org/33217] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 23:10:21,283 INFO [Listener at jenkins-hbase4.apache.org/33217] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportWithTargetName assigned. 2023-07-18 23:10:21,297 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-18 23:10:21,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689721821297 (current time:1689721821297). 2023-07-18 23:10:21,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 23:10:21,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(139): Connect 0x15b80e1b to 127.0.0.1:61306 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 23:10:21,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1e74fefa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 23:10:21,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 23:10:21,308 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36490, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 23:10:21,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x15b80e1b to 127.0.0.1:61306 2023-07-18 23:10:21,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 23:10:21,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(139): Connect 0x2319f1ad to 127.0.0.1:61306 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 23:10:21,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7633f339, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 23:10:21,318 DEBUG [hconnection-0x4b70f388-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 23:10:21,320 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36500, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 23:10:21,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2319f1ad to 127.0.0.1:61306 2023-07-18 23:10:21,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 23:10:21,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-18 23:10:21,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 23:10:21,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-18 23:10:21,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-18 23:10:21,372 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-18 23:10:21,374 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689722421373 2023-07-18 23:10:21,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-18 23:10:21,374 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-18 23:10:21,376 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-18 23:10:21,377 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-18 23:10:21,378 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 12 msec 2023-07-18 23:10:21,379 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-18 23:10:21,380 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689722421380 2023-07-18 23:10:21,380 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 23:10:21,380 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 23:10:21,406 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,406 INFO [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-18 23:10:21,406 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 23:10:21,407 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-18 23:10:21,407 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-18 23:10:21,408 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,408 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,413 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:10:21,413 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:10:21,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:10:21,413 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:10:21,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:10:21,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:10:21,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:10:21,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:10:21,413 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:21,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:10:21,414 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:21,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,414 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:21,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,414 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,414 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,415 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,415 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:21,415 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 23:10:21,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-18 23:10:21,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-18 23:10:21,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-18 23:10:21,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,416 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-18 23:10:21,416 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-18 23:10:21,416 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-18 23:10:21,418 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,418 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,418 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,418 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-18 23:10:21,418 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 23:10:21,419 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-18 23:10:21,419 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-18 23:10:21,419 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-18 23:10:21,419 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 23:10:21,419 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-18 23:10:21,419 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45387,1689721809516' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-18 23:10:21,420 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 23:10:21,420 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-18 23:10:21,421 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-18 23:10:21,421 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-18 23:10:21,421 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-18 23:10:21,421 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45431,1689721809599' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-18 23:10:21,421 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38625,1689721809654' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-18 23:10:21,423 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:21,423 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:21,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:10:21,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:10:21,424 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:21,424 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,424 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:10:21,424 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,424 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 23:10:21,425 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,425 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 23:10:21,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:10:21,425 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,425 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 23:10:21,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:21,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:21,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:21,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:10:21,427 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45387,1689721809516' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-18 23:10:21,428 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b133e5[Count = 1] remaining members to acquire global barrier 2023-07-18 23:10:21,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:21,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:10:21,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:10:21,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:10:21,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:10:21,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:21,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:21,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:21,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:10:21,431 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45431,1689721809599' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-18 23:10:21,431 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b133e5[Count = 0] remaining members to acquire global barrier 2023-07-18 23:10:21,431 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-18 23:10:21,431 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,435 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,435 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,435 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,435 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-18 23:10:21,435 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-18 23:10:21,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,435 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-18 23:10:21,435 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-18 23:10:21,435 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,38625,1689721809654' in zk 2023-07-18 23:10:21,436 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:21,436 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 23:10:21,436 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689721820151.9d2a3d19522e3d381f93366b0e9cc340. 2023-07-18 23:10:21,436 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 23:10:21,437 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689721820151.9d2a3d19522e3d381f93366b0e9cc340. started... 2023-07-18 23:10:21,439 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 23:10:21,439 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689721820151.91442dc89ad96cfd02c0d091962a3305. 2023-07-18 23:10:21,440 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689721820151.91442dc89ad96cfd02c0d091962a3305. started... 2023-07-18 23:10:21,439 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 23:10:21,440 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:21,440 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-18 23:10:21,440 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 23:10:21,441 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 23:10:21,441 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-18 23:10:21,442 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9d2a3d19522e3d381f93366b0e9cc340: 2023-07-18 23:10:21,442 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 91442dc89ad96cfd02c0d091962a3305: 2023-07-18 23:10:21,444 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689721820151.91442dc89ad96cfd02c0d091962a3305.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,444 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689721820151.9d2a3d19522e3d381f93366b0e9cc340.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,449 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 23:10:21,449 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 23:10:21,453 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 23:10:21,453 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 23:10:21,481 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 23:10:21,485 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689721820151.91442dc89ad96cfd02c0d091962a3305. completed. 2023-07-18 23:10:21,485 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689721820151.91442dc89ad96cfd02c0d091962a3305. 2023-07-18 23:10:21,485 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 23:10:21,485 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 23:10:21,485 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:21,486 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-18 23:10:21,486 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45387,1689721809516' in zk 2023-07-18 23:10:21,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-18 23:10:21,488 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689721820151.9d2a3d19522e3d381f93366b0e9cc340. completed. 2023-07-18 23:10:21,488 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689721820151.9d2a3d19522e3d381f93366b0e9cc340. 2023-07-18 23:10:21,488 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 23:10:21,488 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 23:10:21,488 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:21,488 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-18 23:10:21,488 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45431,1689721809599' in zk 2023-07-18 23:10:21,489 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:21,489 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-18 23:10:21,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:21,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:10:21,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:10:21,489 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 23:10:21,489 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-18 23:10:21,491 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-18 23:10:21,491 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:21,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:10:21,491 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 23:10:21,491 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-18 23:10:21,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-18 23:10:21,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:10:21,493 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 23:10:21,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:21,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:21,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:21,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:10:21,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:21,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:21,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:21,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,45387,1689721809516': 2023-07-18 23:10:21,497 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45387,1689721809516' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-18 23:10:21,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:21,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:10:21,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:10:21,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:10:21,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:10:21,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:21,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:21,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:21,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:10:21,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:21,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:21,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:21,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,45431,1689721809599': 2023-07-18 23:10:21,503 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45431,1689721809599' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-18 23:10:21,503 INFO [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-18 23:10:21,503 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 23:10:21,503 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 23:10:21,503 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,503 INFO [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 23:10:21,507 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,507 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,507 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:10:21,507 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:10:21,507 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,507 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:10:21,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:10:21,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,508 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:10:21,508 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:21,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:10:21,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:10:21,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:10:21,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:10:21,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:10:21,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,509 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:21,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:10:21,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:10:21,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,509 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:21,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:10:21,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:21,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:21,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:21,513 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:21,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:10:21,514 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:21,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,514 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:21,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:21,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:21,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:21,529 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:10:21,529 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:21,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:10:21,530 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:10:21,530 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:10:21,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:10:21,530 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:10:21,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:10:21,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:10:21,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:10:21,530 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 23:10:21,530 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,530 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:10:21,530 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:10:21,530 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,530 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:10:21,531 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:21,532 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:21,532 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,532 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:21,532 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,532 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:21,532 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:21,532 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,532 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:10:21,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:10:21,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:10:21,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:10:21,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:10:21,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:10:21,538 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,588 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,652 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-18 23:10:21,653 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,653 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:21,654 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689721821374Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689721821530 (+156 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689721821531 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689721821551 (+20 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689721821574 (+23 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689721821652 (+78 ms) 2023-07-18 23:10:21,655 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-18 23:10:21,658 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 280 msec 2023-07-18 23:10:21,693 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 23:10:21,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-18 23:10:21,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 23:10:21,719 DEBUG [htable-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 23:10:21,724 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45710, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 23:10:21,725 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45387] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689721820151.91442dc89ad96cfd02c0d091962a3305. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 23:10:21,727 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45431] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689721820151.9d2a3d19522e3d381f93366b0e9cc340. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 23:10:21,732 DEBUG [Listener at jenkins-hbase4.apache.org/33217] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-18 23:10:21,733 DEBUG [Listener at jenkins-hbase4.apache.org/33217] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689721820151.9d2a3d19522e3d381f93366b0e9cc340. 2023-07-18 23:10:21,737 INFO [Listener at jenkins-hbase4.apache.org/33217] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 23:10:21,771 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-18 23:10:21,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689721821771 (current time:1689721821771). 2023-07-18 23:10:21,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 23:10:21,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(139): Connect 0x38f50807 to 127.0.0.1:61306 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 23:10:21,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@418d3048, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 23:10:21,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 23:10:21,785 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36506, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 23:10:21,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x38f50807 to 127.0.0.1:61306 2023-07-18 23:10:21,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 23:10:21,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(139): Connect 0x42234752 to 127.0.0.1:61306 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 23:10:21,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5206da21, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 23:10:21,807 DEBUG [hconnection-0x7aa1af59-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 23:10:21,810 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36520, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 23:10:21,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x42234752 to 127.0.0.1:61306 2023-07-18 23:10:21,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 23:10:21,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-18 23:10:21,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 23:10:21,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-18 23:10:21,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-18 23:10:21,823 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-18 23:10:21,824 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689722421824 2023-07-18 23:10:21,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-18 23:10:21,824 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-18 23:10:21,826 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 23:10:21,826 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 23:10:21,827 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-18 23:10:21,829 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-18 23:10:21,831 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 9 msec 2023-07-18 23:10:21,832 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-18 23:10:21,833 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689722421833 2023-07-18 23:10:21,866 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-18 23:10:21,867 INFO [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-18 23:10:21,867 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 23:10:21,868 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-18 23:10:21,868 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-18 23:10:21,869 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 23:10:21,869 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 23:10:21,870 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:10:21,870 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:21,870 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:10:21,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:10:21,870 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:10:21,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:10:21,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:10:21,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:10:21,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:10:21,871 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:21,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:10:21,871 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:21,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 23:10:21,871 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:21,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 23:10:21,871 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 23:10:21,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 23:10:21,872 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 23:10:21,872 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 23:10:21,872 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 23:10:21,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-18 23:10:21,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 23:10:21,873 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-18 23:10:21,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-18 23:10:21,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 23:10:21,873 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-18 23:10:21,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-18 23:10:21,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 23:10:21,873 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-18 23:10:21,874 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-18 23:10:21,875 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-18 23:10:21,875 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-18 23:10:21,875 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-18 23:10:21,875 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 23:10:21,875 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 23:10:21,877 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-18 23:10:21,879 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-18 23:10:21,879 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-18 23:10:21,879 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-18 23:10:21,879 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38625,1689721809654' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-18 23:10:21,879 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-18 23:10:21,879 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-18 23:10:21,879 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45387,1689721809516' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-18 23:10:21,879 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 23:10:21,881 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-18 23:10:21,881 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-18 23:10:21,881 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45431,1689721809599' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-18 23:10:21,883 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 23:10:21,883 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 23:10:21,883 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:21,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:21,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:10:21,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:10:21,884 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:21,884 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 23:10:21,885 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 23:10:21,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:10:21,885 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 23:10:21,885 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 23:10:21,885 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 23:10:21,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:10:21,885 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 23:10:21,885 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 23:10:21,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 23:10:21,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:21,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:21,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:21,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:10:21,891 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45387,1689721809516' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-18 23:10:21,891 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b932975[Count = 1] remaining members to acquire global barrier 2023-07-18 23:10:21,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:21,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:10:21,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:10:21,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:10:21,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:10:21,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 23:10:21,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:21,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:21,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:21,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:10:21,895 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45431,1689721809599' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-18 23:10:21,895 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b932975[Count = 0] remaining members to acquire global barrier 2023-07-18 23:10:21,895 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-18 23:10:21,895 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 23:10:21,899 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 23:10:21,899 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 23:10:21,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 23:10:21,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 23:10:21,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 23:10:21,899 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 23:10:21,900 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-18 23:10:21,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 23:10:21,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 23:10:21,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 23:10:21,900 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-18 23:10:21,900 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 23:10:21,900 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 23:10:21,900 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-18 23:10:21,900 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,38625,1689721809654' in zk 2023-07-18 23:10:21,900 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689721820151.9d2a3d19522e3d381f93366b0e9cc340. 2023-07-18 23:10:21,900 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689721820151.9d2a3d19522e3d381f93366b0e9cc340. started... 2023-07-18 23:10:21,901 INFO [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9d2a3d19522e3d381f93366b0e9cc340 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-18 23:10:21,901 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:21,903 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-18 23:10:21,904 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:21,904 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-18 23:10:21,904 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 23:10:21,904 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 23:10:21,904 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-18 23:10:21,905 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 23:10:21,905 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 23:10:21,907 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689721820151.91442dc89ad96cfd02c0d091962a3305. 2023-07-18 23:10:21,907 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689721820151.91442dc89ad96cfd02c0d091962a3305. started... 2023-07-18 23:10:21,907 INFO [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 91442dc89ad96cfd02c0d091962a3305 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-18 23:10:21,926 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 23:10:21,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-18 23:10:21,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-18 23:10:21,928 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 23:10:22,019 INFO [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportWithTargetName/9d2a3d19522e3d381f93366b0e9cc340/.tmp/cf/bdc32947d95a463998629b6fd035315f 2023-07-18 23:10:22,020 INFO [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportWithTargetName/91442dc89ad96cfd02c0d091962a3305/.tmp/cf/b479d47ba1d84349b70db3bacb3c4320 2023-07-18 23:10:22,073 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportWithTargetName/91442dc89ad96cfd02c0d091962a3305/.tmp/cf/b479d47ba1d84349b70db3bacb3c4320 as hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportWithTargetName/91442dc89ad96cfd02c0d091962a3305/cf/b479d47ba1d84349b70db3bacb3c4320 2023-07-18 23:10:22,073 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportWithTargetName/9d2a3d19522e3d381f93366b0e9cc340/.tmp/cf/bdc32947d95a463998629b6fd035315f as hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportWithTargetName/9d2a3d19522e3d381f93366b0e9cc340/cf/bdc32947d95a463998629b6fd035315f 2023-07-18 23:10:22,084 INFO [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportWithTargetName/91442dc89ad96cfd02c0d091962a3305/cf/b479d47ba1d84349b70db3bacb3c4320, entries=47, sequenceid=6, filesize=8.0 K 2023-07-18 23:10:22,087 INFO [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportWithTargetName/9d2a3d19522e3d381f93366b0e9cc340/cf/bdc32947d95a463998629b6fd035315f, entries=3, sequenceid=6, filesize=5.0 K 2023-07-18 23:10:22,090 INFO [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 9d2a3d19522e3d381f93366b0e9cc340 in 190ms, sequenceid=6, compaction requested=false 2023-07-18 23:10:22,090 INFO [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 91442dc89ad96cfd02c0d091962a3305 in 183ms, sequenceid=6, compaction requested=false 2023-07-18 23:10:22,090 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-18 23:10:22,090 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-18 23:10:22,092 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9d2a3d19522e3d381f93366b0e9cc340: 2023-07-18 23:10:22,092 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 91442dc89ad96cfd02c0d091962a3305: 2023-07-18 23:10:22,093 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689721820151.91442dc89ad96cfd02c0d091962a3305.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-18 23:10:22,093 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689721820151.9d2a3d19522e3d381f93366b0e9cc340.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-18 23:10:22,093 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 23:10:22,093 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 23:10:22,093 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportWithTargetName/91442dc89ad96cfd02c0d091962a3305/cf/b479d47ba1d84349b70db3bacb3c4320] hfiles 2023-07-18 23:10:22,093 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportWithTargetName/9d2a3d19522e3d381f93366b0e9cc340/cf/bdc32947d95a463998629b6fd035315f] hfiles 2023-07-18 23:10:22,093 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportWithTargetName/91442dc89ad96cfd02c0d091962a3305/cf/b479d47ba1d84349b70db3bacb3c4320 for snapshot=snaptb0-testExportWithTargetName 2023-07-18 23:10:22,093 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportWithTargetName/9d2a3d19522e3d381f93366b0e9cc340/cf/bdc32947d95a463998629b6fd035315f for snapshot=snaptb0-testExportWithTargetName 2023-07-18 23:10:22,128 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 23:10:22,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-18 23:10:22,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-18 23:10:22,130 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-18 23:10:22,430 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 23:10:22,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-18 23:10:22,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-18 23:10:22,432 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-18 23:10:22,519 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689721820151.9d2a3d19522e3d381f93366b0e9cc340. completed. 2023-07-18 23:10:22,519 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689721820151.91442dc89ad96cfd02c0d091962a3305. completed. 2023-07-18 23:10:22,519 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689721820151.91442dc89ad96cfd02c0d091962a3305. 2023-07-18 23:10:22,519 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689721820151.9d2a3d19522e3d381f93366b0e9cc340. 2023-07-18 23:10:22,519 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 23:10:22,520 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 23:10:22,520 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:22,519 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 23:10:22,520 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 23:10:22,520 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:22,520 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-18 23:10:22,520 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-18 23:10:22,520 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45387,1689721809516' in zk 2023-07-18 23:10:22,520 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45431,1689721809599' in zk 2023-07-18 23:10:22,523 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-18 23:10:22,523 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 23:10:22,523 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-18 23:10:22,523 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:22,525 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-18 23:10:22,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:22,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:10:22,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:10:22,525 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:22,525 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 23:10:22,525 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-18 23:10:22,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:10:22,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:10:22,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 23:10:22,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:22,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:22,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:22,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:10:22,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 23:10:22,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:22,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:22,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:22,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,45387,1689721809516': 2023-07-18 23:10:22,531 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45387,1689721809516' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-18 23:10:22,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:22,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:10:22,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:10:22,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:10:22,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:10:22,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 23:10:22,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:22,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:22,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:22,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:10:22,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 23:10:22,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:22,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:22,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:22,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,45431,1689721809599': 2023-07-18 23:10:22,536 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45431,1689721809599' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-18 23:10:22,536 INFO [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-18 23:10:22,536 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 23:10:22,536 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 23:10:22,536 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-18 23:10:22,536 INFO [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 23:10:22,538 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 23:10:22,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 23:10:22,539 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 23:10:22,539 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:10:22,538 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 23:10:22,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 23:10:22,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 23:10:22,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:10:22,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:10:22,539 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 23:10:22,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 23:10:22,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 23:10:22,539 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:10:22,539 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:22,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 23:10:22,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:10:22,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:10:22,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 23:10:22,539 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:10:22,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:10:22,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:10:22,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 23:10:22,540 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:22,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 23:10:22,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:10:22,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:10:22,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:10:22,541 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:22,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:10:22,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 23:10:22,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 23:10:22,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:22,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:22,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:22,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 23:10:22,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:10:22,543 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:22,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 23:10:22,544 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:22,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:22,544 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:22,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:22,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:22,559 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:10:22,559 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:10:22,559 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:10:22,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:10:22,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:10:22,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:10:22,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:10:22,559 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:10:22,559 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:10:22,560 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:10:22,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:10:22,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:10:22,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:10:22,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:10:22,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:10:22,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:10:22,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:10:22,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:10:22,564 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:22,564 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 23:10:22,564 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:22,564 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:22,564 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 23:10:22,564 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:22,564 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 23:10:22,564 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-18 23:10:22,570 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-18 23:10:22,564 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 23:10:22,570 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:22,570 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:22,570 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 23:10:22,570 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 23:10:22,571 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-18 23:10:22,624 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-18 23:10:22,700 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-18 23:10:22,700 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-18 23:10:22,700 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-18 23:10:22,701 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689721821824Consolidate snapshot: snaptb0-testExportWithTargetName at 1689721822570 (+746 ms)Loading Region manifests for snaptb0-testExportWithTargetName at 1689721822570Writing data manifest for snaptb0-testExportWithTargetName at 1689721822582 (+12 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689721822612 (+30 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689721822700 (+88 ms) 2023-07-18 23:10:22,703 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-18 23:10:22,705 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 877 msec 2023-07-18 23:10:22,933 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 23:10:22,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-18 23:10:22,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 23:10:22,936 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/export-test/export-1689721822936 2023-07-18 23:10:22,937 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45655, tgtDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/export-test/export-1689721822936, rawTgtDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/export-test/export-1689721822936, srcFsUri=hdfs://localhost:45655, srcDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054 2023-07-18 23:10:22,976 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45655, inputRoot=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054 2023-07-18 23:10:22,976 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1336265334_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/export-test/export-1689721822936, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/export-test/export-1689721822936/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-18 23:10:22,977 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45655, inputRoot=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054, snapshotDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-18 23:10:22,997 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/export-test/export-1689721822936/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-18 23:10:23,474 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-18 23:10:23,475 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-18 23:10:23,475 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-18 23:10:23,475 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-18 23:10:24,496 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/hadoop-771094136650000660.jar 2023-07-18 23:10:24,496 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-18 23:10:24,497 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-18 23:10:24,574 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/hadoop-3382145113334221145.jar 2023-07-18 23:10:24,575 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-18 23:10:24,575 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-18 23:10:24,576 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-18 23:10:24,577 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-18 23:10:24,577 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-18 23:10:24,578 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-18 23:10:24,578 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-18 23:10:24,579 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-18 23:10:24,579 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-18 23:10:24,580 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-18 23:10:24,580 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-18 23:10:24,581 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-18 23:10:24,582 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-18 23:10:24,582 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-18 23:10:24,583 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-18 23:10:24,584 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-18 23:10:24,588 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 23:10:24,589 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 23:10:24,589 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 23:10:24,590 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 23:10:24,590 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 23:10:24,591 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 23:10:24,592 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 23:10:25,551 WARN [Listener at jenkins-hbase4.apache.org/33217] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-18 23:10:25,556 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-18 23:10:25,566 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-18 23:10:26,174 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 23:10:26,176 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 23:10:26,187 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 23:10:26,809 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689721818645_0001_000001 (auth:SIMPLE) 2023-07-18 23:10:32,189 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689721818645_0001_000001 (auth:SIMPLE) 2023-07-18 23:10:34,478 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689721818645_0001_000001 (auth:SIMPLE) 2023-07-18 23:10:37,511 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689721818645_0001_000001 (auth:SIMPLE) 2023-07-18 23:10:39,590 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-18 23:10:39,592 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-18 23:10:39,602 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-18 23:10:39,603 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-18 23:10:39,603 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-18 23:10:39,603 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-702194233_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-18 23:10:39,604 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(367): hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-18 23:10:39,604 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(367): hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-18 23:10:39,604 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-702194233_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/export-test/export-1689721822936/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/export-test/export-1689721822936/.hbase-snapshot/testExportWithTargetName 2023-07-18 23:10:39,605 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(367): hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/export-test/export-1689721822936/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-18 23:10:39,605 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(367): hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/export-test/export-1689721822936/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-18 23:10:39,616 INFO [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-18 23:10:39,621 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-18 23:10:39,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-18 23:10:39,634 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689721839634"}]},"ts":"1689721839634"} 2023-07-18 23:10:39,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-18 23:10:39,636 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-18 23:10:39,638 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-18 23:10:39,640 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9d2a3d19522e3d381f93366b0e9cc340, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=91442dc89ad96cfd02c0d091962a3305, UNASSIGN}] 2023-07-18 23:10:39,642 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9d2a3d19522e3d381f93366b0e9cc340, UNASSIGN 2023-07-18 23:10:39,642 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=91442dc89ad96cfd02c0d091962a3305, UNASSIGN 2023-07-18 23:10:39,644 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=9d2a3d19522e3d381f93366b0e9cc340, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:39,644 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=91442dc89ad96cfd02c0d091962a3305, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:39,644 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689721820151.9d2a3d19522e3d381f93366b0e9cc340.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689721839644"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689721839644"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689721839644"}]},"ts":"1689721839644"} 2023-07-18 23:10:39,644 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689721820151.91442dc89ad96cfd02c0d091962a3305.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689721839644"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689721839644"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689721839644"}]},"ts":"1689721839644"} 2023-07-18 23:10:39,646 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure 91442dc89ad96cfd02c0d091962a3305, server=jenkins-hbase4.apache.org,45387,1689721809516}] 2023-07-18 23:10:39,648 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure 9d2a3d19522e3d381f93366b0e9cc340, server=jenkins-hbase4.apache.org,45431,1689721809599}] 2023-07-18 23:10:39,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-18 23:10:39,809 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 91442dc89ad96cfd02c0d091962a3305 2023-07-18 23:10:39,809 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9d2a3d19522e3d381f93366b0e9cc340 2023-07-18 23:10:39,809 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 91442dc89ad96cfd02c0d091962a3305, disabling compactions & flushes 2023-07-18 23:10:39,809 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9d2a3d19522e3d381f93366b0e9cc340, disabling compactions & flushes 2023-07-18 23:10:39,809 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689721820151.91442dc89ad96cfd02c0d091962a3305. 2023-07-18 23:10:39,809 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689721820151.9d2a3d19522e3d381f93366b0e9cc340. 2023-07-18 23:10:39,809 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689721820151.91442dc89ad96cfd02c0d091962a3305. 2023-07-18 23:10:39,809 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689721820151.9d2a3d19522e3d381f93366b0e9cc340. 2023-07-18 23:10:39,809 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689721820151.91442dc89ad96cfd02c0d091962a3305. after waiting 0 ms 2023-07-18 23:10:39,809 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689721820151.9d2a3d19522e3d381f93366b0e9cc340. after waiting 0 ms 2023-07-18 23:10:39,809 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689721820151.9d2a3d19522e3d381f93366b0e9cc340. 2023-07-18 23:10:39,809 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689721820151.91442dc89ad96cfd02c0d091962a3305. 2023-07-18 23:10:39,823 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportWithTargetName/91442dc89ad96cfd02c0d091962a3305/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 23:10:39,823 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportWithTargetName/9d2a3d19522e3d381f93366b0e9cc340/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 23:10:39,823 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 23:10:39,823 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 23:10:39,824 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689721820151.9d2a3d19522e3d381f93366b0e9cc340. 2023-07-18 23:10:39,824 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689721820151.91442dc89ad96cfd02c0d091962a3305. 2023-07-18 23:10:39,825 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9d2a3d19522e3d381f93366b0e9cc340: 2023-07-18 23:10:39,825 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 91442dc89ad96cfd02c0d091962a3305: 2023-07-18 23:10:39,827 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9d2a3d19522e3d381f93366b0e9cc340 2023-07-18 23:10:39,827 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=9d2a3d19522e3d381f93366b0e9cc340, regionState=CLOSED 2023-07-18 23:10:39,828 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689721820151.9d2a3d19522e3d381f93366b0e9cc340.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689721839827"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689721839827"}]},"ts":"1689721839827"} 2023-07-18 23:10:39,828 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 91442dc89ad96cfd02c0d091962a3305 2023-07-18 23:10:39,828 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=91442dc89ad96cfd02c0d091962a3305, regionState=CLOSED 2023-07-18 23:10:39,829 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689721820151.91442dc89ad96cfd02c0d091962a3305.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689721839828"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689721839828"}]},"ts":"1689721839828"} 2023-07-18 23:10:39,833 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=22 2023-07-18 23:10:39,833 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure 9d2a3d19522e3d381f93366b0e9cc340, server=jenkins-hbase4.apache.org,45431,1689721809599 in 182 msec 2023-07-18 23:10:39,833 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-07-18 23:10:39,834 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure 91442dc89ad96cfd02c0d091962a3305, server=jenkins-hbase4.apache.org,45387,1689721809516 in 185 msec 2023-07-18 23:10:39,834 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9d2a3d19522e3d381f93366b0e9cc340, UNASSIGN in 193 msec 2023-07-18 23:10:39,836 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=21 2023-07-18 23:10:39,836 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=91442dc89ad96cfd02c0d091962a3305, UNASSIGN in 193 msec 2023-07-18 23:10:39,837 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689721839837"}]},"ts":"1689721839837"} 2023-07-18 23:10:39,839 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-18 23:10:39,841 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-18 23:10:39,844 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 218 msec 2023-07-18 23:10:39,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-18 23:10:39,938 INFO [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-18 23:10:39,943 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-18 23:10:39,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-18 23:10:39,952 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-18 23:10:39,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-18 23:10:39,954 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-18 23:10:39,957 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45387] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-18 23:10:39,961 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportWithTargetName/9d2a3d19522e3d381f93366b0e9cc340 2023-07-18 23:10:39,961 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportWithTargetName/91442dc89ad96cfd02c0d091962a3305 2023-07-18 23:10:39,964 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-18 23:10:39,964 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-18 23:10:39,964 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-18 23:10:39,964 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-18 23:10:39,965 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-18 23:10:39,965 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportWithTargetName/9d2a3d19522e3d381f93366b0e9cc340/cf, FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportWithTargetName/9d2a3d19522e3d381f93366b0e9cc340/recovered.edits] 2023-07-18 23:10:39,965 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportWithTargetName/91442dc89ad96cfd02c0d091962a3305/cf, FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportWithTargetName/91442dc89ad96cfd02c0d091962a3305/recovered.edits] 2023-07-18 23:10:39,965 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-18 23:10:39,965 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-18 23:10:39,967 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-18 23:10:39,967 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 23:10:39,967 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-18 23:10:39,967 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 23:10:39,967 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 23:10:39,968 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-18 23:10:39,968 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 23:10:39,968 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-18 23:10:39,968 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-18 23:10:39,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-18 23:10:39,978 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportWithTargetName/9d2a3d19522e3d381f93366b0e9cc340/cf/bdc32947d95a463998629b6fd035315f to hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/archive/data/default/testtb-testExportWithTargetName/9d2a3d19522e3d381f93366b0e9cc340/cf/bdc32947d95a463998629b6fd035315f 2023-07-18 23:10:39,978 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportWithTargetName/91442dc89ad96cfd02c0d091962a3305/cf/b479d47ba1d84349b70db3bacb3c4320 to hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/archive/data/default/testtb-testExportWithTargetName/91442dc89ad96cfd02c0d091962a3305/cf/b479d47ba1d84349b70db3bacb3c4320 2023-07-18 23:10:39,982 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportWithTargetName/9d2a3d19522e3d381f93366b0e9cc340/recovered.edits/9.seqid to hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/archive/data/default/testtb-testExportWithTargetName/9d2a3d19522e3d381f93366b0e9cc340/recovered.edits/9.seqid 2023-07-18 23:10:39,983 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportWithTargetName/91442dc89ad96cfd02c0d091962a3305/recovered.edits/9.seqid to hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/archive/data/default/testtb-testExportWithTargetName/91442dc89ad96cfd02c0d091962a3305/recovered.edits/9.seqid 2023-07-18 23:10:39,983 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportWithTargetName/9d2a3d19522e3d381f93366b0e9cc340 2023-07-18 23:10:39,983 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportWithTargetName/91442dc89ad96cfd02c0d091962a3305 2023-07-18 23:10:39,984 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-18 23:10:39,986 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-18 23:10:40,007 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-18 23:10:40,010 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-18 23:10:40,012 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-18 23:10:40,012 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-18 23:10:40,012 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689721820151.9d2a3d19522e3d381f93366b0e9cc340.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689721840012"}]},"ts":"9223372036854775807"} 2023-07-18 23:10:40,012 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689721820151.91442dc89ad96cfd02c0d091962a3305.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689721840012"}]},"ts":"9223372036854775807"} 2023-07-18 23:10:40,019 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-18 23:10:40,019 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9d2a3d19522e3d381f93366b0e9cc340, NAME => 'testtb-testExportWithTargetName,,1689721820151.9d2a3d19522e3d381f93366b0e9cc340.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 91442dc89ad96cfd02c0d091962a3305, NAME => 'testtb-testExportWithTargetName,1,1689721820151.91442dc89ad96cfd02c0d091962a3305.', STARTKEY => '1', ENDKEY => ''}] 2023-07-18 23:10:40,020 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-18 23:10:40,020 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689721840020"}]},"ts":"9223372036854775807"} 2023-07-18 23:10:40,022 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-18 23:10:40,025 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-18 23:10:40,027 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 81 msec 2023-07-18 23:10:40,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-18 23:10:40,072 INFO [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-18 23:10:40,093 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-18 23:10:40,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-18 23:10:40,098 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-18 23:10:40,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-18 23:10:40,129 INFO [Listener at jenkins-hbase4.apache.org/33217] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=754 (was 709) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/cluster_58864cd1-a7cd-0177-9e77-6a825cf5c04f/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/cluster_58864cd1-a7cd-0177-9e77-6a825cf5c04f/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (337744187) connection to jenkins-hbase4.apache.org/172.31.14.131:40959 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1284 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x32c52efa-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-702194233_17 at /127.0.0.1:37366 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/cluster_58864cd1-a7cd-0177-9e77-6a825cf5c04f/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-611061142_1 at /127.0.0.1:34018 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x32c52efa-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (337744187) connection to jenkins-hbase4.apache.org/172.31.14.131:44851 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/cluster_58864cd1-a7cd-0177-9e77-6a825cf5c04f/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x32c52efa-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-611061142_1 at /127.0.0.1:37334 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-702194233_17 at /127.0.0.1:34046 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x32c52efa-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/cluster_58864cd1-a7cd-0177-9e77-6a825cf5c04f/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1593971636_17 at /127.0.0.1:54352 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/cluster_58864cd1-a7cd-0177-9e77-6a825cf5c04f/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=914 (was 896) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=366 (was 429), ProcessCount=183 (was 177) - ProcessCount LEAK? -, AvailableMemoryMB=2767 (was 4525) 2023-07-18 23:10:40,130 WARN [Listener at jenkins-hbase4.apache.org/33217] hbase.ResourceChecker(130): Thread=754 is superior to 500 2023-07-18 23:10:40,152 INFO [Listener at jenkins-hbase4.apache.org/33217] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=754, OpenFileDescriptor=914, MaxFileDescriptor=60000, SystemLoadAverage=366, ProcessCount=183, AvailableMemoryMB=2766 2023-07-18 23:10:40,152 WARN [Listener at jenkins-hbase4.apache.org/33217] hbase.ResourceChecker(130): Thread=754 is superior to 500 2023-07-18 23:10:40,154 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-18 23:10:40,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-18 23:10:40,160 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 23:10:40,160 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-18 23:10:40,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-18 23:10:40,163 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 23:10:40,167 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemState/40a60de5a96ac5b7db7a8c74adb0fa01 2023-07-18 23:10:40,167 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemState/cc84d97fd472542aeda04d38b8805c5a 2023-07-18 23:10:40,167 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemState/40a60de5a96ac5b7db7a8c74adb0fa01 empty. 2023-07-18 23:10:40,167 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemState/cc84d97fd472542aeda04d38b8805c5a empty. 2023-07-18 23:10:40,168 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemState/40a60de5a96ac5b7db7a8c74adb0fa01 2023-07-18 23:10:40,168 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemState/cc84d97fd472542aeda04d38b8805c5a 2023-07-18 23:10:40,168 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-18 23:10:40,192 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-18 23:10:40,194 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => cc84d97fd472542aeda04d38b8805c5a, NAME => 'testtb-testExportFileSystemState,1,1689721840154.cc84d97fd472542aeda04d38b8805c5a.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp 2023-07-18 23:10:40,194 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 40a60de5a96ac5b7db7a8c74adb0fa01, NAME => 'testtb-testExportFileSystemState,,1689721840154.40a60de5a96ac5b7db7a8c74adb0fa01.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp 2023-07-18 23:10:40,226 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689721840154.40a60de5a96ac5b7db7a8c74adb0fa01.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 23:10:40,226 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 40a60de5a96ac5b7db7a8c74adb0fa01, disabling compactions & flushes 2023-07-18 23:10:40,226 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689721840154.cc84d97fd472542aeda04d38b8805c5a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 23:10:40,226 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689721840154.40a60de5a96ac5b7db7a8c74adb0fa01. 2023-07-18 23:10:40,227 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing cc84d97fd472542aeda04d38b8805c5a, disabling compactions & flushes 2023-07-18 23:10:40,227 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689721840154.40a60de5a96ac5b7db7a8c74adb0fa01. 2023-07-18 23:10:40,227 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689721840154.cc84d97fd472542aeda04d38b8805c5a. 2023-07-18 23:10:40,227 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689721840154.40a60de5a96ac5b7db7a8c74adb0fa01. after waiting 0 ms 2023-07-18 23:10:40,228 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689721840154.cc84d97fd472542aeda04d38b8805c5a. 2023-07-18 23:10:40,228 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689721840154.40a60de5a96ac5b7db7a8c74adb0fa01. 2023-07-18 23:10:40,228 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689721840154.cc84d97fd472542aeda04d38b8805c5a. after waiting 0 ms 2023-07-18 23:10:40,228 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689721840154.40a60de5a96ac5b7db7a8c74adb0fa01. 2023-07-18 23:10:40,228 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689721840154.cc84d97fd472542aeda04d38b8805c5a. 2023-07-18 23:10:40,228 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 40a60de5a96ac5b7db7a8c74adb0fa01: 2023-07-18 23:10:40,228 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689721840154.cc84d97fd472542aeda04d38b8805c5a. 2023-07-18 23:10:40,228 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for cc84d97fd472542aeda04d38b8805c5a: 2023-07-18 23:10:40,233 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 23:10:40,234 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689721840154.40a60de5a96ac5b7db7a8c74adb0fa01.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689721840234"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689721840234"}]},"ts":"1689721840234"} 2023-07-18 23:10:40,235 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689721840154.cc84d97fd472542aeda04d38b8805c5a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689721840234"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689721840234"}]},"ts":"1689721840234"} 2023-07-18 23:10:40,238 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-18 23:10:40,239 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 23:10:40,240 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689721840239"}]},"ts":"1689721840239"} 2023-07-18 23:10:40,243 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-18 23:10:40,247 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 23:10:40,249 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 23:10:40,249 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 23:10:40,249 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 23:10:40,249 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 23:10:40,250 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=40a60de5a96ac5b7db7a8c74adb0fa01, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cc84d97fd472542aeda04d38b8805c5a, ASSIGN}] 2023-07-18 23:10:40,253 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=40a60de5a96ac5b7db7a8c74adb0fa01, ASSIGN 2023-07-18 23:10:40,253 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cc84d97fd472542aeda04d38b8805c5a, ASSIGN 2023-07-18 23:10:40,254 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=40a60de5a96ac5b7db7a8c74adb0fa01, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38625,1689721809654; forceNewPlan=false, retain=false 2023-07-18 23:10:40,254 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cc84d97fd472542aeda04d38b8805c5a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45387,1689721809516; forceNewPlan=false, retain=false 2023-07-18 23:10:40,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-18 23:10:40,404 INFO [jenkins-hbase4:46651] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-18 23:10:40,407 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=40a60de5a96ac5b7db7a8c74adb0fa01, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:40,407 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=cc84d97fd472542aeda04d38b8805c5a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:40,407 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689721840154.cc84d97fd472542aeda04d38b8805c5a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689721840407"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689721840407"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689721840407"}]},"ts":"1689721840407"} 2023-07-18 23:10:40,407 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689721840154.40a60de5a96ac5b7db7a8c74adb0fa01.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689721840407"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689721840407"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689721840407"}]},"ts":"1689721840407"} 2023-07-18 23:10:40,410 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure 40a60de5a96ac5b7db7a8c74adb0fa01, server=jenkins-hbase4.apache.org,38625,1689721809654}] 2023-07-18 23:10:40,411 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure cc84d97fd472542aeda04d38b8805c5a, server=jenkins-hbase4.apache.org,45387,1689721809516}] 2023-07-18 23:10:40,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-18 23:10:40,564 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:40,564 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-18 23:10:40,569 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33730, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-18 23:10:40,573 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689721840154.cc84d97fd472542aeda04d38b8805c5a. 2023-07-18 23:10:40,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cc84d97fd472542aeda04d38b8805c5a, NAME => 'testtb-testExportFileSystemState,1,1689721840154.cc84d97fd472542aeda04d38b8805c5a.', STARTKEY => '1', ENDKEY => ''} 2023-07-18 23:10:40,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689721840154.cc84d97fd472542aeda04d38b8805c5a. service=AccessControlService 2023-07-18 23:10:40,575 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 23:10:40,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState cc84d97fd472542aeda04d38b8805c5a 2023-07-18 23:10:40,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689721840154.cc84d97fd472542aeda04d38b8805c5a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 23:10:40,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cc84d97fd472542aeda04d38b8805c5a 2023-07-18 23:10:40,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cc84d97fd472542aeda04d38b8805c5a 2023-07-18 23:10:40,577 INFO [StoreOpener-cc84d97fd472542aeda04d38b8805c5a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region cc84d97fd472542aeda04d38b8805c5a 2023-07-18 23:10:40,577 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689721840154.40a60de5a96ac5b7db7a8c74adb0fa01. 2023-07-18 23:10:40,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 40a60de5a96ac5b7db7a8c74adb0fa01, NAME => 'testtb-testExportFileSystemState,,1689721840154.40a60de5a96ac5b7db7a8c74adb0fa01.', STARTKEY => '', ENDKEY => '1'} 2023-07-18 23:10:40,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689721840154.40a60de5a96ac5b7db7a8c74adb0fa01. service=AccessControlService 2023-07-18 23:10:40,578 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 23:10:40,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 40a60de5a96ac5b7db7a8c74adb0fa01 2023-07-18 23:10:40,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689721840154.40a60de5a96ac5b7db7a8c74adb0fa01.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 23:10:40,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 40a60de5a96ac5b7db7a8c74adb0fa01 2023-07-18 23:10:40,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 40a60de5a96ac5b7db7a8c74adb0fa01 2023-07-18 23:10:40,578 DEBUG [StoreOpener-cc84d97fd472542aeda04d38b8805c5a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemState/cc84d97fd472542aeda04d38b8805c5a/cf 2023-07-18 23:10:40,578 DEBUG [StoreOpener-cc84d97fd472542aeda04d38b8805c5a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemState/cc84d97fd472542aeda04d38b8805c5a/cf 2023-07-18 23:10:40,579 INFO [StoreOpener-cc84d97fd472542aeda04d38b8805c5a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cc84d97fd472542aeda04d38b8805c5a columnFamilyName cf 2023-07-18 23:10:40,579 INFO [StoreOpener-40a60de5a96ac5b7db7a8c74adb0fa01-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 40a60de5a96ac5b7db7a8c74adb0fa01 2023-07-18 23:10:40,579 INFO [StoreOpener-cc84d97fd472542aeda04d38b8805c5a-1] regionserver.HStore(310): Store=cc84d97fd472542aeda04d38b8805c5a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 23:10:40,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemState/cc84d97fd472542aeda04d38b8805c5a 2023-07-18 23:10:40,582 DEBUG [StoreOpener-40a60de5a96ac5b7db7a8c74adb0fa01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemState/40a60de5a96ac5b7db7a8c74adb0fa01/cf 2023-07-18 23:10:40,582 DEBUG [StoreOpener-40a60de5a96ac5b7db7a8c74adb0fa01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemState/40a60de5a96ac5b7db7a8c74adb0fa01/cf 2023-07-18 23:10:40,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemState/cc84d97fd472542aeda04d38b8805c5a 2023-07-18 23:10:40,582 INFO [StoreOpener-40a60de5a96ac5b7db7a8c74adb0fa01-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 40a60de5a96ac5b7db7a8c74adb0fa01 columnFamilyName cf 2023-07-18 23:10:40,583 INFO [StoreOpener-40a60de5a96ac5b7db7a8c74adb0fa01-1] regionserver.HStore(310): Store=40a60de5a96ac5b7db7a8c74adb0fa01/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 23:10:40,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemState/40a60de5a96ac5b7db7a8c74adb0fa01 2023-07-18 23:10:40,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cc84d97fd472542aeda04d38b8805c5a 2023-07-18 23:10:40,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemState/40a60de5a96ac5b7db7a8c74adb0fa01 2023-07-18 23:10:40,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 40a60de5a96ac5b7db7a8c74adb0fa01 2023-07-18 23:10:40,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemState/cc84d97fd472542aeda04d38b8805c5a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 23:10:40,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemState/40a60de5a96ac5b7db7a8c74adb0fa01/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 23:10:40,599 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cc84d97fd472542aeda04d38b8805c5a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73715981, jitterRate=0.09845371544361115}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 23:10:40,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cc84d97fd472542aeda04d38b8805c5a: 2023-07-18 23:10:40,599 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 40a60de5a96ac5b7db7a8c74adb0fa01; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72293767, jitterRate=0.0772610753774643}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 23:10:40,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 40a60de5a96ac5b7db7a8c74adb0fa01: 2023-07-18 23:10:40,600 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689721840154.cc84d97fd472542aeda04d38b8805c5a., pid=31, masterSystemTime=1689721840564 2023-07-18 23:10:40,600 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689721840154.40a60de5a96ac5b7db7a8c74adb0fa01., pid=30, masterSystemTime=1689721840564 2023-07-18 23:10:40,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689721840154.cc84d97fd472542aeda04d38b8805c5a. 2023-07-18 23:10:40,603 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689721840154.cc84d97fd472542aeda04d38b8805c5a. 2023-07-18 23:10:40,604 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=cc84d97fd472542aeda04d38b8805c5a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:40,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689721840154.40a60de5a96ac5b7db7a8c74adb0fa01. 2023-07-18 23:10:40,605 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689721840154.40a60de5a96ac5b7db7a8c74adb0fa01. 2023-07-18 23:10:40,605 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689721840154.cc84d97fd472542aeda04d38b8805c5a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689721840604"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689721840604"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689721840604"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689721840604"}]},"ts":"1689721840604"} 2023-07-18 23:10:40,606 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=40a60de5a96ac5b7db7a8c74adb0fa01, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:40,606 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689721840154.40a60de5a96ac5b7db7a8c74adb0fa01.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689721840606"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689721840606"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689721840606"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689721840606"}]},"ts":"1689721840606"} 2023-07-18 23:10:40,610 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-07-18 23:10:40,611 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure cc84d97fd472542aeda04d38b8805c5a, server=jenkins-hbase4.apache.org,45387,1689721809516 in 196 msec 2023-07-18 23:10:40,613 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=28 2023-07-18 23:10:40,614 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure 40a60de5a96ac5b7db7a8c74adb0fa01, server=jenkins-hbase4.apache.org,38625,1689721809654 in 198 msec 2023-07-18 23:10:40,615 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cc84d97fd472542aeda04d38b8805c5a, ASSIGN in 362 msec 2023-07-18 23:10:40,617 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-18 23:10:40,617 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=40a60de5a96ac5b7db7a8c74adb0fa01, ASSIGN in 364 msec 2023-07-18 23:10:40,618 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 23:10:40,618 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689721840618"}]},"ts":"1689721840618"} 2023-07-18 23:10:40,620 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-18 23:10:40,623 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 23:10:40,623 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-18 23:10:40,626 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45387] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-18 23:10:40,627 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 23:10:40,627 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 23:10:40,627 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 23:10:40,627 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 23:10:40,629 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-18 23:10:40,629 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-18 23:10:40,630 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-18 23:10:40,630 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-18 23:10:40,634 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 475 msec 2023-07-18 23:10:40,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-18 23:10:40,766 INFO [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-18 23:10:40,766 DEBUG [Listener at jenkins-hbase4.apache.org/33217] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemState get assigned. Timeout = 60000ms 2023-07-18 23:10:40,766 INFO [Listener at jenkins-hbase4.apache.org/33217] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 23:10:40,770 INFO [Listener at jenkins-hbase4.apache.org/33217] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemState assigned to meta. Checking AM states. 2023-07-18 23:10:40,770 INFO [Listener at jenkins-hbase4.apache.org/33217] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 23:10:40,770 INFO [Listener at jenkins-hbase4.apache.org/33217] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemState assigned. 2023-07-18 23:10:40,774 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 23:10:40,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689721840774 (current time:1689721840774). 2023-07-18 23:10:40,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 23:10:40,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(139): Connect 0x6fa8ae90 to 127.0.0.1:61306 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 23:10:40,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2a1924aa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 23:10:40,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 23:10:40,793 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47312, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 23:10:40,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6fa8ae90 to 127.0.0.1:61306 2023-07-18 23:10:40,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 23:10:40,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(139): Connect 0x1b3b89c6 to 127.0.0.1:61306 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 23:10:40,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31cd681f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 23:10:40,802 DEBUG [hconnection-0x529236f8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 23:10:40,803 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47322, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 23:10:40,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1b3b89c6 to 127.0.0.1:61306 2023-07-18 23:10:40,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 23:10:40,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-18 23:10:40,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 23:10:40,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 23:10:40,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-18 23:10:40,814 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-18 23:10:40,815 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689722440815 2023-07-18 23:10:40,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 23:10:40,815 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-18 23:10:40,816 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 23:10:40,816 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 23:10:40,817 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-18 23:10:40,818 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-18 23:10:40,820 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-18 23:10:40,820 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-18 23:10:40,821 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689722440821 2023-07-18 23:10:40,839 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,839 INFO [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-18 23:10:40,839 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 23:10:40,841 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-18 23:10:40,841 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-18 23:10:40,841 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,841 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,844 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:10:40,844 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:10:40,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:10:40,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:10:40,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:10:40,844 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:40,844 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:10:40,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:10:40,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:10:40,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:10:40,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,846 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:40,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,846 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:40,846 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,846 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,847 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:40,847 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 23:10:40,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-18 23:10:40,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,847 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-18 23:10:40,847 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-18 23:10:40,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,848 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-18 23:10:40,848 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,848 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-18 23:10:40,848 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 23:10:40,848 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-18 23:10:40,850 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-18 23:10:40,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,850 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-18 23:10:40,850 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-18 23:10:40,850 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-18 23:10:40,850 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 23:10:40,850 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38625,1689721809654' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-18 23:10:40,852 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-18 23:10:40,852 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,852 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-18 23:10:40,852 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-18 23:10:40,852 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 23:10:40,852 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45431,1689721809599' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-18 23:10:40,853 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-18 23:10:40,853 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-18 23:10:40,853 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45387,1689721809516' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-18 23:10:40,855 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,862 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,862 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,863 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,863 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 23:10:40,862 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:40,863 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:40,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:40,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:10:40,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:10:40,864 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:10:40,864 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,864 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 23:10:40,864 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 23:10:40,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:10:40,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:40,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:40,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:40,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:10:40,867 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38625,1689721809654' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-18 23:10:40,867 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@738fb5c6[Count = 1] remaining members to acquire global barrier 2023-07-18 23:10:40,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:40,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:10:40,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:10:40,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:10:40,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:10:40,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:40,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:40,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:40,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:10:40,870 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45387,1689721809516' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-18 23:10:40,870 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@738fb5c6[Count = 0] remaining members to acquire global barrier 2023-07-18 23:10:40,870 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-18 23:10:40,871 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,872 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,872 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,872 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,872 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-18 23:10:40,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,872 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-18 23:10:40,872 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-18 23:10:40,872 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:40,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,872 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45431,1689721809599' in zk 2023-07-18 23:10:40,873 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-18 23:10:40,873 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 23:10:40,873 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 23:10:40,873 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689721840154.40a60de5a96ac5b7db7a8c74adb0fa01. 2023-07-18 23:10:40,873 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:40,873 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 23:10:40,873 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689721840154.40a60de5a96ac5b7db7a8c74adb0fa01. started... 2023-07-18 23:10:40,874 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 23:10:40,884 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689721840154.cc84d97fd472542aeda04d38b8805c5a. 2023-07-18 23:10:40,884 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 23:10:40,884 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-18 23:10:40,884 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689721840154.cc84d97fd472542aeda04d38b8805c5a. started... 2023-07-18 23:10:40,884 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 40a60de5a96ac5b7db7a8c74adb0fa01: 2023-07-18 23:10:40,884 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 23:10:40,886 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cc84d97fd472542aeda04d38b8805c5a: 2023-07-18 23:10:40,886 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-18 23:10:40,887 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689721840154.40a60de5a96ac5b7db7a8c74adb0fa01.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,888 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689721840154.cc84d97fd472542aeda04d38b8805c5a.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,888 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 23:10:40,888 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 23:10:40,888 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 23:10:40,888 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 23:10:40,920 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 23:10:40,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 23:10:40,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-18 23:10:40,924 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 23:10:40,927 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689721840154.cc84d97fd472542aeda04d38b8805c5a. completed. 2023-07-18 23:10:40,927 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689721840154.cc84d97fd472542aeda04d38b8805c5a. 2023-07-18 23:10:40,928 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 23:10:40,928 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 23:10:40,928 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:40,928 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-18 23:10:40,928 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45387,1689721809516' in zk 2023-07-18 23:10:40,930 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:40,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:40,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:10:40,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:10:40,930 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-18 23:10:40,930 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 23:10:40,931 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-18 23:10:40,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:10:40,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:10:40,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:40,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:40,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:40,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:10:40,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,941 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689721840154.40a60de5a96ac5b7db7a8c74adb0fa01. completed. 2023-07-18 23:10:40,941 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689721840154.40a60de5a96ac5b7db7a8c74adb0fa01. 2023-07-18 23:10:40,941 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 23:10:40,941 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 23:10:40,941 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:40,941 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-18 23:10:40,941 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38625,1689721809654' in zk 2023-07-18 23:10:40,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:40,945 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-18 23:10:40,945 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 23:10:40,945 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:40,945 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-18 23:10:40,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:40,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45387,1689721809516': 2023-07-18 23:10:40,948 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45387,1689721809516' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-18 23:10:40,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:40,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:10:40,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:10:40,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:10:40,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:10:40,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:40,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:40,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:40,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:10:40,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:40,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:40,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:40,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,38625,1689721809654': 2023-07-18 23:10:40,955 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38625,1689721809654' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-18 23:10:40,955 INFO [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-18 23:10:40,955 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 23:10:40,955 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 23:10:40,955 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,955 INFO [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 23:10:40,957 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,957 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,957 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,957 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,957 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:10:40,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,957 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:10:40,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,957 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:10:40,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:10:40,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:10:40,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:10:40,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:10:40,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,958 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:40,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:10:40,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:10:40,959 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:40,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:10:40,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:10:40,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:10:40,959 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:40,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:10:40,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:40,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:40,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:40,962 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:40,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:10:40,962 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:40,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,963 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:40,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:40,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:40,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:40,967 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:10:40,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:10:40,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:10:40,967 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:40,967 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,967 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:10:40,967 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:10:40,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:10:40,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:10:40,967 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:40,967 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,967 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:10:40,967 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,967 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:10:40,967 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 23:10:40,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:10:40,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:10:40,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:10:40,967 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:10:40,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:10:40,967 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:40,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:10:40,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:10:40,969 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,970 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:40,970 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,970 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:40,970 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:40,970 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,970 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,970 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:40,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:10:40,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:10:40,995 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:41,040 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-18 23:10:41,040 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:41,040 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:41,040 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689721840815Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689721840967 (+152 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689721840967Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689721840974 (+7 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689721840988 (+14 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689721841040 (+52 ms) 2023-07-18 23:10:41,043 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-18 23:10:41,047 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 227 msec 2023-07-18 23:10:41,124 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 23:10:41,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 23:10:41,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 23:10:41,134 DEBUG [htable-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 23:10:41,140 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33742, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 23:10:41,141 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38625] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689721840154.40a60de5a96ac5b7db7a8c74adb0fa01. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 23:10:41,141 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45387] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689721840154.cc84d97fd472542aeda04d38b8805c5a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 23:10:41,147 DEBUG [Listener at jenkins-hbase4.apache.org/33217] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-18 23:10:41,148 DEBUG [Listener at jenkins-hbase4.apache.org/33217] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689721840154.40a60de5a96ac5b7db7a8c74adb0fa01. 2023-07-18 23:10:41,149 INFO [Listener at jenkins-hbase4.apache.org/33217] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 23:10:41,161 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 23:10:41,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689721841161 (current time:1689721841161). 2023-07-18 23:10:41,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 23:10:41,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(139): Connect 0x4f80d717 to 127.0.0.1:61306 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 23:10:41,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40687d20, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 23:10:41,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 23:10:41,171 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47334, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 23:10:41,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4f80d717 to 127.0.0.1:61306 2023-07-18 23:10:41,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 23:10:41,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(139): Connect 0x22e75469 to 127.0.0.1:61306 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 23:10:41,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6814e672, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 23:10:41,181 DEBUG [hconnection-0x7f9252db-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 23:10:41,184 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47350, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 23:10:41,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x22e75469 to 127.0.0.1:61306 2023-07-18 23:10:41,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 23:10:41,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-18 23:10:41,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 23:10:41,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 23:10:41,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-18 23:10:41,193 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-18 23:10:41,194 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689722441194 2023-07-18 23:10:41,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 23:10:41,194 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-18 23:10:41,195 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 23:10:41,195 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 23:10:41,196 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-18 23:10:41,196 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-18 23:10:41,198 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-07-18 23:10:41,199 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-18 23:10:41,199 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689722441199 2023-07-18 23:10:41,209 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-18 23:10:41,209 INFO [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-18 23:10:41,209 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 23:10:41,210 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-18 23:10:41,210 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-18 23:10:41,211 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 23:10:41,211 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 23:10:41,212 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:10:41,212 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:10:41,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:10:41,212 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:10:41,212 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:41,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:10:41,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:10:41,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:10:41,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:10:41,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:10:41,213 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:41,213 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:41,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 23:10:41,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 23:10:41,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 23:10:41,213 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:41,213 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 23:10:41,213 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 23:10:41,213 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 23:10:41,213 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 23:10:41,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-18 23:10:41,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-18 23:10:41,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-18 23:10:41,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 23:10:41,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 23:10:41,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 23:10:41,214 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-18 23:10:41,214 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-18 23:10:41,214 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-18 23:10:41,214 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-18 23:10:41,214 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-18 23:10:41,214 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-18 23:10:41,214 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-18 23:10:41,214 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-18 23:10:41,214 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-18 23:10:41,215 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 23:10:41,214 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 23:10:41,215 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 23:10:41,216 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-18 23:10:41,217 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-18 23:10:41,215 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-18 23:10:41,217 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45387,1689721809516' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-18 23:10:41,217 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-18 23:10:41,217 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-18 23:10:41,217 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-18 23:10:41,217 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38625,1689721809654' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-18 23:10:41,217 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45431,1689721809599' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-18 23:10:41,220 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:41,220 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 23:10:41,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:41,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:10:41,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:10:41,221 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:41,221 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 23:10:41,221 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 23:10:41,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:10:41,221 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 23:10:41,221 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 23:10:41,222 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 23:10:41,222 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 23:10:41,222 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 23:10:41,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:10:41,222 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 23:10:41,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 23:10:41,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:41,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:41,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:41,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:10:41,223 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45387,1689721809516' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-18 23:10:41,223 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a4db407[Count = 1] remaining members to acquire global barrier 2023-07-18 23:10:41,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:41,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:10:41,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:10:41,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:10:41,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:10:41,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 23:10:41,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:41,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:41,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:41,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:10:41,225 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38625,1689721809654' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-18 23:10:41,225 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a4db407[Count = 0] remaining members to acquire global barrier 2023-07-18 23:10:41,225 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-18 23:10:41,226 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 23:10:41,227 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 23:10:41,227 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 23:10:41,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 23:10:41,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 23:10:41,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 23:10:41,227 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 23:10:41,227 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-18 23:10:41,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 23:10:41,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 23:10:41,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 23:10:41,227 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-18 23:10:41,227 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-18 23:10:41,227 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689721840154.cc84d97fd472542aeda04d38b8805c5a. 2023-07-18 23:10:41,227 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:41,227 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689721840154.cc84d97fd472542aeda04d38b8805c5a. started... 2023-07-18 23:10:41,227 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-18 23:10:41,228 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 23:10:41,228 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 23:10:41,227 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 23:10:41,228 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 23:10:41,228 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689721840154.40a60de5a96ac5b7db7a8c74adb0fa01. 2023-07-18 23:10:41,228 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:41,228 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45431,1689721809599' in zk 2023-07-18 23:10:41,228 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 23:10:41,228 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689721840154.40a60de5a96ac5b7db7a8c74adb0fa01. started... 2023-07-18 23:10:41,228 INFO [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] regionserver.HRegion(2745): Flushing cc84d97fd472542aeda04d38b8805c5a 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-18 23:10:41,228 INFO [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 40a60de5a96ac5b7db7a8c74adb0fa01 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-18 23:10:41,229 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-18 23:10:41,232 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 23:10:41,232 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-18 23:10:41,248 INFO [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemState/40a60de5a96ac5b7db7a8c74adb0fa01/.tmp/cf/7d1929fcc71a46239996e01b9fda51c4 2023-07-18 23:10:41,250 INFO [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemState/cc84d97fd472542aeda04d38b8805c5a/.tmp/cf/f6e6f6f2b4c84e368b3d0b08046ec38c 2023-07-18 23:10:41,268 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemState/cc84d97fd472542aeda04d38b8805c5a/.tmp/cf/f6e6f6f2b4c84e368b3d0b08046ec38c as hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemState/cc84d97fd472542aeda04d38b8805c5a/cf/f6e6f6f2b4c84e368b3d0b08046ec38c 2023-07-18 23:10:41,271 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemState/40a60de5a96ac5b7db7a8c74adb0fa01/.tmp/cf/7d1929fcc71a46239996e01b9fda51c4 as hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemState/40a60de5a96ac5b7db7a8c74adb0fa01/cf/7d1929fcc71a46239996e01b9fda51c4 2023-07-18 23:10:41,282 INFO [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemState/40a60de5a96ac5b7db7a8c74adb0fa01/cf/7d1929fcc71a46239996e01b9fda51c4, entries=3, sequenceid=6, filesize=5.0 K 2023-07-18 23:10:41,283 INFO [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemState/cc84d97fd472542aeda04d38b8805c5a/cf/f6e6f6f2b4c84e368b3d0b08046ec38c, entries=47, sequenceid=6, filesize=8 K 2023-07-18 23:10:41,289 INFO [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 40a60de5a96ac5b7db7a8c74adb0fa01 in 61ms, sequenceid=6, compaction requested=false 2023-07-18 23:10:41,289 INFO [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for cc84d97fd472542aeda04d38b8805c5a in 61ms, sequenceid=6, compaction requested=false 2023-07-18 23:10:41,289 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-18 23:10:41,289 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-18 23:10:41,293 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cc84d97fd472542aeda04d38b8805c5a: 2023-07-18 23:10:41,293 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689721840154.cc84d97fd472542aeda04d38b8805c5a.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-18 23:10:41,293 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 23:10:41,294 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemState/cc84d97fd472542aeda04d38b8805c5a/cf/f6e6f6f2b4c84e368b3d0b08046ec38c] hfiles 2023-07-18 23:10:41,294 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemState/cc84d97fd472542aeda04d38b8805c5a/cf/f6e6f6f2b4c84e368b3d0b08046ec38c for snapshot=snaptb0-testExportFileSystemState 2023-07-18 23:10:41,294 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 40a60de5a96ac5b7db7a8c74adb0fa01: 2023-07-18 23:10:41,294 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689721840154.40a60de5a96ac5b7db7a8c74adb0fa01.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-18 23:10:41,294 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 23:10:41,294 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemState/40a60de5a96ac5b7db7a8c74adb0fa01/cf/7d1929fcc71a46239996e01b9fda51c4] hfiles 2023-07-18 23:10:41,294 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemState/40a60de5a96ac5b7db7a8c74adb0fa01/cf/7d1929fcc71a46239996e01b9fda51c4 for snapshot=snaptb0-testExportFileSystemState 2023-07-18 23:10:41,295 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 23:10:41,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 23:10:41,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-18 23:10:41,297 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 23:10:41,331 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689721840154.40a60de5a96ac5b7db7a8c74adb0fa01. completed. 2023-07-18 23:10:41,331 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689721840154.40a60de5a96ac5b7db7a8c74adb0fa01. 2023-07-18 23:10:41,331 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 23:10:41,331 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 23:10:41,331 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:41,338 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-18 23:10:41,339 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38625,1689721809654' in zk 2023-07-18 23:10:41,347 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:41,347 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-18 23:10:41,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:41,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:10:41,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:10:41,347 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 23:10:41,347 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-18 23:10:41,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:10:41,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:10:41,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 23:10:41,352 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689721840154.cc84d97fd472542aeda04d38b8805c5a. completed. 2023-07-18 23:10:41,352 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689721840154.cc84d97fd472542aeda04d38b8805c5a. 2023-07-18 23:10:41,352 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 23:10:41,352 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 23:10:41,352 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:41,352 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-18 23:10:41,352 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45387,1689721809516' in zk 2023-07-18 23:10:41,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:41,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:41,354 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:41,354 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-18 23:10:41,354 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 23:10:41,354 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-18 23:10:41,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:41,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:10:41,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 23:10:41,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:41,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:41,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:41,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,38625,1689721809654': 2023-07-18 23:10:41,359 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38625,1689721809654' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-18 23:10:41,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:41,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:10:41,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:10:41,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:10:41,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:10:41,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 23:10:41,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:41,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:41,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:41,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:10:41,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 23:10:41,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:41,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:41,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:41,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45387,1689721809516': 2023-07-18 23:10:41,366 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45387,1689721809516' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-18 23:10:41,366 INFO [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-18 23:10:41,366 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 23:10:41,366 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 23:10:41,366 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-18 23:10:41,366 INFO [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 23:10:41,368 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 23:10:41,368 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 23:10:41,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 23:10:41,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 23:10:41,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:10:41,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:10:41,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 23:10:41,368 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 23:10:41,368 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:10:41,368 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 23:10:41,369 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:10:41,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 23:10:41,368 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:10:41,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:10:41,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:10:41,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 23:10:41,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:10:41,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 23:10:41,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 23:10:41,369 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:41,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:10:41,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 23:10:41,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:10:41,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:10:41,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:10:41,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 23:10:41,371 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:41,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 23:10:41,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 23:10:41,371 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:41,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:10:41,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 23:10:41,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:41,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:41,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:41,374 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:41,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:10:41,374 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:41,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 23:10:41,375 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:41,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:41,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:41,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:41,381 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:10:41,381 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:41,381 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 23:10:41,381 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:10:41,381 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:10:41,381 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:10:41,381 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:41,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:10:41,381 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-18 23:10:41,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:10:41,381 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-18 23:10:41,381 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 23:10:41,381 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:41,381 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 23:10:41,381 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:41,381 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 23:10:41,381 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:41,382 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:41,382 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 23:10:41,382 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 23:10:41,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:10:41,381 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:10:41,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:10:41,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:10:41,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:10:41,381 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:10:41,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:10:41,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:10:41,384 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-18 23:10:41,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:10:41,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:10:41,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:10:41,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:10:41,428 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-18 23:10:41,478 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-18 23:10:41,478 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-18 23:10:41,479 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-18 23:10:41,479 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689721841194Consolidate snapshot: snaptb0-testExportFileSystemState at 1689721841381 (+187 ms)Loading Region manifests for snaptb0-testExportFileSystemState at 1689721841381Writing data manifest for snaptb0-testExportFileSystemState at 1689721841389 (+8 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689721841420 (+31 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689721841478 (+58 ms) 2023-07-18 23:10:41,482 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-18 23:10:41,484 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 287 msec 2023-07-18 23:10:41,497 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 23:10:41,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 23:10:41,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 23:10:41,500 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/export-test/export-1689721841500 2023-07-18 23:10:41,500 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45655, tgtDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/export-test/export-1689721841500, rawTgtDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/export-test/export-1689721841500, srcFsUri=hdfs://localhost:45655, srcDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054 2023-07-18 23:10:41,535 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45655, inputRoot=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054 2023-07-18 23:10:41,535 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-896844127_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/export-test/export-1689721841500, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/export-test/export-1689721841500/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-18 23:10:41,535 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45655, inputRoot=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054, snapshotDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-18 23:10:41,562 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/export-test/export-1689721841500/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-18 23:10:41,603 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-18 23:10:41,604 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-18 23:10:41,605 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-18 23:10:41,605 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-18 23:10:42,539 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/hadoop-3731489972422291508.jar 2023-07-18 23:10:42,540 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-18 23:10:42,540 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-18 23:10:42,609 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/hadoop-6226054119251821544.jar 2023-07-18 23:10:42,609 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-18 23:10:42,610 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-18 23:10:42,610 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-18 23:10:42,611 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-18 23:10:42,611 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-18 23:10:42,611 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-18 23:10:42,612 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-18 23:10:42,612 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-18 23:10:42,613 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-18 23:10:42,613 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-18 23:10:42,614 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-18 23:10:42,614 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-18 23:10:42,615 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-18 23:10:42,615 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-18 23:10:42,615 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-18 23:10:42,616 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-18 23:10:42,616 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 23:10:42,617 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 23:10:42,617 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 23:10:42,618 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 23:10:42,618 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 23:10:42,619 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 23:10:42,619 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 23:10:43,138 WARN [Listener at jenkins-hbase4.apache.org/33217] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-18 23:10:43,141 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-18 23:10:43,144 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-18 23:10:43,729 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 23:10:43,735 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 23:10:43,743 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689721818645_0001_000001 (auth:SIMPLE) 2023-07-18 23:10:44,049 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689721818645_0002_000001 (auth:SIMPLE) 2023-07-18 23:10:45,424 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 23:10:48,869 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689721818645_0002_000001 (auth:SIMPLE) 2023-07-18 23:10:51,105 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689721818645_0002_000001 (auth:SIMPLE) 2023-07-18 23:10:53,848 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689721818645_0002_000001 (auth:SIMPLE) 2023-07-18 23:10:55,784 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-18 23:10:55,787 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-18 23:10:55,796 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-18 23:10:55,796 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-18 23:10:55,796 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-18 23:10:55,797 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-702194233_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-18 23:10:55,797 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(367): hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-18 23:10:55,797 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(367): hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-18 23:10:55,797 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-702194233_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/export-test/export-1689721841500/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/export-test/export-1689721841500/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-18 23:10:55,798 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(367): hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/export-test/export-1689721841500/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-18 23:10:55,798 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(367): hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/export-test/export-1689721841500/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-18 23:10:55,805 INFO [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-18 23:10:55,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-18 23:10:55,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-18 23:10:55,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-18 23:10:55,810 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689721855810"}]},"ts":"1689721855810"} 2023-07-18 23:10:55,812 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-18 23:10:55,813 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-18 23:10:55,814 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=40a60de5a96ac5b7db7a8c74adb0fa01, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cc84d97fd472542aeda04d38b8805c5a, UNASSIGN}] 2023-07-18 23:10:55,816 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=40a60de5a96ac5b7db7a8c74adb0fa01, UNASSIGN 2023-07-18 23:10:55,816 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cc84d97fd472542aeda04d38b8805c5a, UNASSIGN 2023-07-18 23:10:55,817 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=40a60de5a96ac5b7db7a8c74adb0fa01, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:55,817 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689721840154.40a60de5a96ac5b7db7a8c74adb0fa01.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689721855817"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689721855817"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689721855817"}]},"ts":"1689721855817"} 2023-07-18 23:10:55,817 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=cc84d97fd472542aeda04d38b8805c5a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:55,818 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689721840154.cc84d97fd472542aeda04d38b8805c5a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689721855817"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689721855817"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689721855817"}]},"ts":"1689721855817"} 2023-07-18 23:10:55,819 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 40a60de5a96ac5b7db7a8c74adb0fa01, server=jenkins-hbase4.apache.org,38625,1689721809654}] 2023-07-18 23:10:55,820 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure cc84d97fd472542aeda04d38b8805c5a, server=jenkins-hbase4.apache.org,45387,1689721809516}] 2023-07-18 23:10:55,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-18 23:10:55,971 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close cc84d97fd472542aeda04d38b8805c5a 2023-07-18 23:10:55,971 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cc84d97fd472542aeda04d38b8805c5a, disabling compactions & flushes 2023-07-18 23:10:55,971 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 40a60de5a96ac5b7db7a8c74adb0fa01 2023-07-18 23:10:55,971 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689721840154.cc84d97fd472542aeda04d38b8805c5a. 2023-07-18 23:10:55,972 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689721840154.cc84d97fd472542aeda04d38b8805c5a. 2023-07-18 23:10:55,972 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689721840154.cc84d97fd472542aeda04d38b8805c5a. after waiting 0 ms 2023-07-18 23:10:55,972 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 40a60de5a96ac5b7db7a8c74adb0fa01, disabling compactions & flushes 2023-07-18 23:10:55,972 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689721840154.cc84d97fd472542aeda04d38b8805c5a. 2023-07-18 23:10:55,972 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689721840154.40a60de5a96ac5b7db7a8c74adb0fa01. 2023-07-18 23:10:55,972 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689721840154.40a60de5a96ac5b7db7a8c74adb0fa01. 2023-07-18 23:10:55,972 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689721840154.40a60de5a96ac5b7db7a8c74adb0fa01. after waiting 0 ms 2023-07-18 23:10:55,972 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689721840154.40a60de5a96ac5b7db7a8c74adb0fa01. 2023-07-18 23:10:55,985 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemState/cc84d97fd472542aeda04d38b8805c5a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 23:10:55,985 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemState/40a60de5a96ac5b7db7a8c74adb0fa01/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 23:10:55,986 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 23:10:55,986 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 23:10:55,988 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689721840154.cc84d97fd472542aeda04d38b8805c5a. 2023-07-18 23:10:55,988 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689721840154.40a60de5a96ac5b7db7a8c74adb0fa01. 2023-07-18 23:10:55,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cc84d97fd472542aeda04d38b8805c5a: 2023-07-18 23:10:55,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 40a60de5a96ac5b7db7a8c74adb0fa01: 2023-07-18 23:10:55,990 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 40a60de5a96ac5b7db7a8c74adb0fa01 2023-07-18 23:10:55,990 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=40a60de5a96ac5b7db7a8c74adb0fa01, regionState=CLOSED 2023-07-18 23:10:55,990 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed cc84d97fd472542aeda04d38b8805c5a 2023-07-18 23:10:55,990 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689721840154.40a60de5a96ac5b7db7a8c74adb0fa01.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689721855990"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689721855990"}]},"ts":"1689721855990"} 2023-07-18 23:10:55,991 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=cc84d97fd472542aeda04d38b8805c5a, regionState=CLOSED 2023-07-18 23:10:55,991 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689721840154.cc84d97fd472542aeda04d38b8805c5a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689721855991"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689721855991"}]},"ts":"1689721855991"} 2023-07-18 23:10:55,994 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-18 23:10:55,994 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 40a60de5a96ac5b7db7a8c74adb0fa01, server=jenkins-hbase4.apache.org,38625,1689721809654 in 173 msec 2023-07-18 23:10:55,995 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-18 23:10:55,995 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure cc84d97fd472542aeda04d38b8805c5a, server=jenkins-hbase4.apache.org,45387,1689721809516 in 173 msec 2023-07-18 23:10:55,996 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=40a60de5a96ac5b7db7a8c74adb0fa01, UNASSIGN in 180 msec 2023-07-18 23:10:55,997 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-18 23:10:55,997 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cc84d97fd472542aeda04d38b8805c5a, UNASSIGN in 181 msec 2023-07-18 23:10:55,999 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689721855999"}]},"ts":"1689721855999"} 2023-07-18 23:10:56,000 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-18 23:10:56,002 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-18 23:10:56,005 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 198 msec 2023-07-18 23:10:56,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-18 23:10:56,112 INFO [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-18 23:10:56,113 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-18 23:10:56,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-18 23:10:56,117 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-18 23:10:56,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-18 23:10:56,118 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-18 23:10:56,119 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45387] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-18 23:10:56,123 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-18 23:10:56,123 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-18 23:10:56,123 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-18 23:10:56,123 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-18 23:10:56,124 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-18 23:10:56,124 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-18 23:10:56,124 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-18 23:10:56,124 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-18 23:10:56,124 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemState/40a60de5a96ac5b7db7a8c74adb0fa01 2023-07-18 23:10:56,124 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemState/cc84d97fd472542aeda04d38b8805c5a 2023-07-18 23:10:56,125 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-18 23:10:56,125 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-18 23:10:56,125 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-18 23:10:56,125 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 23:10:56,125 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 23:10:56,125 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 23:10:56,125 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-18 23:10:56,125 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 23:10:56,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-18 23:10:56,127 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemState/40a60de5a96ac5b7db7a8c74adb0fa01/cf, FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemState/40a60de5a96ac5b7db7a8c74adb0fa01/recovered.edits] 2023-07-18 23:10:56,127 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemState/cc84d97fd472542aeda04d38b8805c5a/cf, FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemState/cc84d97fd472542aeda04d38b8805c5a/recovered.edits] 2023-07-18 23:10:56,131 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemState/40a60de5a96ac5b7db7a8c74adb0fa01/cf/7d1929fcc71a46239996e01b9fda51c4 to hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/archive/data/default/testtb-testExportFileSystemState/40a60de5a96ac5b7db7a8c74adb0fa01/cf/7d1929fcc71a46239996e01b9fda51c4 2023-07-18 23:10:56,132 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemState/cc84d97fd472542aeda04d38b8805c5a/cf/f6e6f6f2b4c84e368b3d0b08046ec38c to hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/archive/data/default/testtb-testExportFileSystemState/cc84d97fd472542aeda04d38b8805c5a/cf/f6e6f6f2b4c84e368b3d0b08046ec38c 2023-07-18 23:10:56,135 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemState/40a60de5a96ac5b7db7a8c74adb0fa01/recovered.edits/9.seqid to hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/archive/data/default/testtb-testExportFileSystemState/40a60de5a96ac5b7db7a8c74adb0fa01/recovered.edits/9.seqid 2023-07-18 23:10:56,135 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemState/cc84d97fd472542aeda04d38b8805c5a/recovered.edits/9.seqid to hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/archive/data/default/testtb-testExportFileSystemState/cc84d97fd472542aeda04d38b8805c5a/recovered.edits/9.seqid 2023-07-18 23:10:56,136 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemState/40a60de5a96ac5b7db7a8c74adb0fa01 2023-07-18 23:10:56,136 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemState/cc84d97fd472542aeda04d38b8805c5a 2023-07-18 23:10:56,136 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-18 23:10:56,138 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-18 23:10:56,140 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-18 23:10:56,143 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-18 23:10:56,144 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-18 23:10:56,144 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-18 23:10:56,144 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689721840154.40a60de5a96ac5b7db7a8c74adb0fa01.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689721856144"}]},"ts":"9223372036854775807"} 2023-07-18 23:10:56,144 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689721840154.cc84d97fd472542aeda04d38b8805c5a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689721856144"}]},"ts":"9223372036854775807"} 2023-07-18 23:10:56,146 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-18 23:10:56,146 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 40a60de5a96ac5b7db7a8c74adb0fa01, NAME => 'testtb-testExportFileSystemState,,1689721840154.40a60de5a96ac5b7db7a8c74adb0fa01.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => cc84d97fd472542aeda04d38b8805c5a, NAME => 'testtb-testExportFileSystemState,1,1689721840154.cc84d97fd472542aeda04d38b8805c5a.', STARTKEY => '1', ENDKEY => ''}] 2023-07-18 23:10:56,146 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-18 23:10:56,146 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689721856146"}]},"ts":"9223372036854775807"} 2023-07-18 23:10:56,148 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-18 23:10:56,150 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-18 23:10:56,151 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 37 msec 2023-07-18 23:10:56,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-18 23:10:56,227 INFO [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-18 23:10:56,234 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-18 23:10:56,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-18 23:10:56,239 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-18 23:10:56,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-18 23:10:56,267 INFO [Listener at jenkins-hbase4.apache.org/33217] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=767 (was 754) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-702194233_17 at /127.0.0.1:35106 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x32c52efa-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (337744187) connection to jenkins-hbase4.apache.org/172.31.14.131:35473 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1099638141_1 at /127.0.0.1:35078 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x32c52efa-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-702194233_17 at /127.0.0.1:33936 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1948 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1099638141_1 at /127.0.0.1:32906 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x32c52efa-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x32c52efa-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-702194233_17 at /127.0.0.1:32928 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=916 (was 914) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=382 (was 366) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 183), AvailableMemoryMB=2601 (was 2766) 2023-07-18 23:10:56,267 WARN [Listener at jenkins-hbase4.apache.org/33217] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-07-18 23:10:56,287 INFO [Listener at jenkins-hbase4.apache.org/33217] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=767, OpenFileDescriptor=916, MaxFileDescriptor=60000, SystemLoadAverage=382, ProcessCount=183, AvailableMemoryMB=2601 2023-07-18 23:10:56,287 WARN [Listener at jenkins-hbase4.apache.org/33217] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-07-18 23:10:56,289 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-18 23:10:56,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-18 23:10:56,292 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 23:10:56,292 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-18 23:10:56,293 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 23:10:56,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-18 23:10:56,295 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testConsecutiveExports/793a1e99e6874a89ce1e013596e47890 2023-07-18 23:10:56,295 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testConsecutiveExports/74a5581cc1bcad54e4de2da1b36f3fad 2023-07-18 23:10:56,296 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testConsecutiveExports/793a1e99e6874a89ce1e013596e47890 empty. 2023-07-18 23:10:56,296 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testConsecutiveExports/74a5581cc1bcad54e4de2da1b36f3fad empty. 2023-07-18 23:10:56,296 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testConsecutiveExports/793a1e99e6874a89ce1e013596e47890 2023-07-18 23:10:56,296 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testConsecutiveExports/74a5581cc1bcad54e4de2da1b36f3fad 2023-07-18 23:10:56,296 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-18 23:10:56,314 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-18 23:10:56,316 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 793a1e99e6874a89ce1e013596e47890, NAME => 'testtb-testConsecutiveExports,,1689721856288.793a1e99e6874a89ce1e013596e47890.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp 2023-07-18 23:10:56,316 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 74a5581cc1bcad54e4de2da1b36f3fad, NAME => 'testtb-testConsecutiveExports,1,1689721856288.74a5581cc1bcad54e4de2da1b36f3fad.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp 2023-07-18 23:10:56,340 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689721856288.74a5581cc1bcad54e4de2da1b36f3fad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 23:10:56,340 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 74a5581cc1bcad54e4de2da1b36f3fad, disabling compactions & flushes 2023-07-18 23:10:56,340 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689721856288.74a5581cc1bcad54e4de2da1b36f3fad. 2023-07-18 23:10:56,340 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689721856288.74a5581cc1bcad54e4de2da1b36f3fad. 2023-07-18 23:10:56,340 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689721856288.74a5581cc1bcad54e4de2da1b36f3fad. after waiting 0 ms 2023-07-18 23:10:56,340 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689721856288.74a5581cc1bcad54e4de2da1b36f3fad. 2023-07-18 23:10:56,340 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689721856288.74a5581cc1bcad54e4de2da1b36f3fad. 2023-07-18 23:10:56,340 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 74a5581cc1bcad54e4de2da1b36f3fad: 2023-07-18 23:10:56,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-18 23:10:56,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-18 23:10:56,740 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689721856288.793a1e99e6874a89ce1e013596e47890.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 23:10:56,740 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 793a1e99e6874a89ce1e013596e47890, disabling compactions & flushes 2023-07-18 23:10:56,741 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689721856288.793a1e99e6874a89ce1e013596e47890. 2023-07-18 23:10:56,741 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689721856288.793a1e99e6874a89ce1e013596e47890. 2023-07-18 23:10:56,741 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689721856288.793a1e99e6874a89ce1e013596e47890. after waiting 0 ms 2023-07-18 23:10:56,741 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689721856288.793a1e99e6874a89ce1e013596e47890. 2023-07-18 23:10:56,741 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689721856288.793a1e99e6874a89ce1e013596e47890. 2023-07-18 23:10:56,741 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 793a1e99e6874a89ce1e013596e47890: 2023-07-18 23:10:56,746 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 23:10:56,747 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689721856288.74a5581cc1bcad54e4de2da1b36f3fad.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689721856747"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689721856747"}]},"ts":"1689721856747"} 2023-07-18 23:10:56,747 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689721856288.793a1e99e6874a89ce1e013596e47890.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689721856747"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689721856747"}]},"ts":"1689721856747"} 2023-07-18 23:10:56,750 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-18 23:10:56,751 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 23:10:56,751 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689721856751"}]},"ts":"1689721856751"} 2023-07-18 23:10:56,753 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-18 23:10:56,758 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 23:10:56,759 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 23:10:56,759 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 23:10:56,759 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 23:10:56,759 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 23:10:56,760 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=793a1e99e6874a89ce1e013596e47890, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=74a5581cc1bcad54e4de2da1b36f3fad, ASSIGN}] 2023-07-18 23:10:56,763 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=74a5581cc1bcad54e4de2da1b36f3fad, ASSIGN 2023-07-18 23:10:56,763 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=793a1e99e6874a89ce1e013596e47890, ASSIGN 2023-07-18 23:10:56,764 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=74a5581cc1bcad54e4de2da1b36f3fad, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45431,1689721809599; forceNewPlan=false, retain=false 2023-07-18 23:10:56,764 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=793a1e99e6874a89ce1e013596e47890, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38625,1689721809654; forceNewPlan=false, retain=false 2023-07-18 23:10:56,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-18 23:10:56,914 INFO [jenkins-hbase4:46651] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-18 23:10:56,917 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=793a1e99e6874a89ce1e013596e47890, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:56,917 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=74a5581cc1bcad54e4de2da1b36f3fad, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:56,917 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689721856288.793a1e99e6874a89ce1e013596e47890.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689721856917"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689721856917"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689721856917"}]},"ts":"1689721856917"} 2023-07-18 23:10:56,917 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689721856288.74a5581cc1bcad54e4de2da1b36f3fad.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689721856917"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689721856917"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689721856917"}]},"ts":"1689721856917"} 2023-07-18 23:10:56,919 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 793a1e99e6874a89ce1e013596e47890, server=jenkins-hbase4.apache.org,38625,1689721809654}] 2023-07-18 23:10:56,920 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 74a5581cc1bcad54e4de2da1b36f3fad, server=jenkins-hbase4.apache.org,45431,1689721809599}] 2023-07-18 23:10:57,075 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689721856288.793a1e99e6874a89ce1e013596e47890. 2023-07-18 23:10:57,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 793a1e99e6874a89ce1e013596e47890, NAME => 'testtb-testConsecutiveExports,,1689721856288.793a1e99e6874a89ce1e013596e47890.', STARTKEY => '', ENDKEY => '1'} 2023-07-18 23:10:57,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689721856288.793a1e99e6874a89ce1e013596e47890. service=AccessControlService 2023-07-18 23:10:57,077 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 23:10:57,077 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 793a1e99e6874a89ce1e013596e47890 2023-07-18 23:10:57,077 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689721856288.793a1e99e6874a89ce1e013596e47890.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 23:10:57,077 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 793a1e99e6874a89ce1e013596e47890 2023-07-18 23:10:57,077 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 793a1e99e6874a89ce1e013596e47890 2023-07-18 23:10:57,078 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689721856288.74a5581cc1bcad54e4de2da1b36f3fad. 2023-07-18 23:10:57,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 74a5581cc1bcad54e4de2da1b36f3fad, NAME => 'testtb-testConsecutiveExports,1,1689721856288.74a5581cc1bcad54e4de2da1b36f3fad.', STARTKEY => '1', ENDKEY => ''} 2023-07-18 23:10:57,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689721856288.74a5581cc1bcad54e4de2da1b36f3fad. service=AccessControlService 2023-07-18 23:10:57,079 INFO [StoreOpener-793a1e99e6874a89ce1e013596e47890-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 793a1e99e6874a89ce1e013596e47890 2023-07-18 23:10:57,079 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 23:10:57,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 74a5581cc1bcad54e4de2da1b36f3fad 2023-07-18 23:10:57,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689721856288.74a5581cc1bcad54e4de2da1b36f3fad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 23:10:57,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 74a5581cc1bcad54e4de2da1b36f3fad 2023-07-18 23:10:57,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 74a5581cc1bcad54e4de2da1b36f3fad 2023-07-18 23:10:57,080 DEBUG [StoreOpener-793a1e99e6874a89ce1e013596e47890-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testConsecutiveExports/793a1e99e6874a89ce1e013596e47890/cf 2023-07-18 23:10:57,080 DEBUG [StoreOpener-793a1e99e6874a89ce1e013596e47890-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testConsecutiveExports/793a1e99e6874a89ce1e013596e47890/cf 2023-07-18 23:10:57,080 INFO [StoreOpener-74a5581cc1bcad54e4de2da1b36f3fad-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 74a5581cc1bcad54e4de2da1b36f3fad 2023-07-18 23:10:57,081 INFO [StoreOpener-793a1e99e6874a89ce1e013596e47890-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 793a1e99e6874a89ce1e013596e47890 columnFamilyName cf 2023-07-18 23:10:57,081 INFO [StoreOpener-793a1e99e6874a89ce1e013596e47890-1] regionserver.HStore(310): Store=793a1e99e6874a89ce1e013596e47890/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 23:10:57,082 DEBUG [StoreOpener-74a5581cc1bcad54e4de2da1b36f3fad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testConsecutiveExports/74a5581cc1bcad54e4de2da1b36f3fad/cf 2023-07-18 23:10:57,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testConsecutiveExports/793a1e99e6874a89ce1e013596e47890 2023-07-18 23:10:57,082 DEBUG [StoreOpener-74a5581cc1bcad54e4de2da1b36f3fad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testConsecutiveExports/74a5581cc1bcad54e4de2da1b36f3fad/cf 2023-07-18 23:10:57,083 INFO [StoreOpener-74a5581cc1bcad54e4de2da1b36f3fad-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 74a5581cc1bcad54e4de2da1b36f3fad columnFamilyName cf 2023-07-18 23:10:57,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testConsecutiveExports/793a1e99e6874a89ce1e013596e47890 2023-07-18 23:10:57,083 INFO [StoreOpener-74a5581cc1bcad54e4de2da1b36f3fad-1] regionserver.HStore(310): Store=74a5581cc1bcad54e4de2da1b36f3fad/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 23:10:57,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testConsecutiveExports/74a5581cc1bcad54e4de2da1b36f3fad 2023-07-18 23:10:57,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testConsecutiveExports/74a5581cc1bcad54e4de2da1b36f3fad 2023-07-18 23:10:57,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 793a1e99e6874a89ce1e013596e47890 2023-07-18 23:10:57,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 74a5581cc1bcad54e4de2da1b36f3fad 2023-07-18 23:10:57,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testConsecutiveExports/793a1e99e6874a89ce1e013596e47890/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 23:10:57,089 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 793a1e99e6874a89ce1e013596e47890; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70975080, jitterRate=0.05761110782623291}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 23:10:57,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 793a1e99e6874a89ce1e013596e47890: 2023-07-18 23:10:57,090 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689721856288.793a1e99e6874a89ce1e013596e47890., pid=45, masterSystemTime=1689721857070 2023-07-18 23:10:57,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testConsecutiveExports/74a5581cc1bcad54e4de2da1b36f3fad/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 23:10:57,091 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 74a5581cc1bcad54e4de2da1b36f3fad; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73640164, jitterRate=0.0973239541053772}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 23:10:57,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 74a5581cc1bcad54e4de2da1b36f3fad: 2023-07-18 23:10:57,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689721856288.793a1e99e6874a89ce1e013596e47890. 2023-07-18 23:10:57,092 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689721856288.793a1e99e6874a89ce1e013596e47890. 2023-07-18 23:10:57,093 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689721856288.74a5581cc1bcad54e4de2da1b36f3fad., pid=46, masterSystemTime=1689721857072 2023-07-18 23:10:57,093 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=793a1e99e6874a89ce1e013596e47890, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:57,093 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689721856288.793a1e99e6874a89ce1e013596e47890.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689721857093"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689721857093"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689721857093"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689721857093"}]},"ts":"1689721857093"} 2023-07-18 23:10:57,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689721856288.74a5581cc1bcad54e4de2da1b36f3fad. 2023-07-18 23:10:57,096 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689721856288.74a5581cc1bcad54e4de2da1b36f3fad. 2023-07-18 23:10:57,096 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=74a5581cc1bcad54e4de2da1b36f3fad, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:57,097 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689721856288.74a5581cc1bcad54e4de2da1b36f3fad.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689721857096"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689721857096"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689721857096"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689721857096"}]},"ts":"1689721857096"} 2023-07-18 23:10:57,098 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-07-18 23:10:57,098 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 793a1e99e6874a89ce1e013596e47890, server=jenkins-hbase4.apache.org,38625,1689721809654 in 177 msec 2023-07-18 23:10:57,100 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=793a1e99e6874a89ce1e013596e47890, ASSIGN in 339 msec 2023-07-18 23:10:57,101 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=44 2023-07-18 23:10:57,101 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 74a5581cc1bcad54e4de2da1b36f3fad, server=jenkins-hbase4.apache.org,45431,1689721809599 in 179 msec 2023-07-18 23:10:57,103 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-07-18 23:10:57,103 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=74a5581cc1bcad54e4de2da1b36f3fad, ASSIGN in 342 msec 2023-07-18 23:10:57,104 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 23:10:57,104 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689721857104"}]},"ts":"1689721857104"} 2023-07-18 23:10:57,106 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-18 23:10:57,108 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 23:10:57,108 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-18 23:10:57,110 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45387] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-18 23:10:57,112 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 23:10:57,112 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 23:10:57,112 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 23:10:57,112 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 23:10:57,114 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-18 23:10:57,114 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-18 23:10:57,114 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-18 23:10:57,114 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-18 23:10:57,115 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 824 msec 2023-07-18 23:10:57,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-18 23:10:57,399 INFO [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-18 23:10:57,399 DEBUG [Listener at jenkins-hbase4.apache.org/33217] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testConsecutiveExports get assigned. Timeout = 60000ms 2023-07-18 23:10:57,399 INFO [Listener at jenkins-hbase4.apache.org/33217] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 23:10:57,402 INFO [Listener at jenkins-hbase4.apache.org/33217] hbase.HBaseTestingUtility(3484): All regions for table testtb-testConsecutiveExports assigned to meta. Checking AM states. 2023-07-18 23:10:57,402 INFO [Listener at jenkins-hbase4.apache.org/33217] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 23:10:57,402 INFO [Listener at jenkins-hbase4.apache.org/33217] hbase.HBaseTestingUtility(3504): All regions for table testtb-testConsecutiveExports assigned. 2023-07-18 23:10:57,405 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-18 23:10:57,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689721857405 (current time:1689721857405). 2023-07-18 23:10:57,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 23:10:57,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(139): Connect 0x4f038384 to 127.0.0.1:61306 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 23:10:57,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a337921, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 23:10:57,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 23:10:57,419 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46976, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 23:10:57,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4f038384 to 127.0.0.1:61306 2023-07-18 23:10:57,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 23:10:57,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(139): Connect 0x6b23413e to 127.0.0.1:61306 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 23:10:57,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@386ff07d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 23:10:57,427 DEBUG [hconnection-0x39147c20-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 23:10:57,430 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46982, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 23:10:57,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6b23413e to 127.0.0.1:61306 2023-07-18 23:10:57,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 23:10:57,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-18 23:10:57,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 23:10:57,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-18 23:10:57,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-18 23:10:57,438 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-18 23:10:57,439 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689722457439 2023-07-18 23:10:57,439 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-18 23:10:57,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-18 23:10:57,440 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 23:10:57,440 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 23:10:57,440 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-18 23:10:57,441 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-18 23:10:57,442 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-07-18 23:10:57,443 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-18 23:10:57,444 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689722457443 2023-07-18 23:10:57,457 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,457 INFO [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-18 23:10:57,457 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 23:10:57,458 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-18 23:10:57,458 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-18 23:10:57,459 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,459 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,461 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:57,461 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:10:57,461 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:10:57,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:10:57,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:10:57,461 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:10:57,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:10:57,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:10:57,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:10:57,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,462 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:57,462 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:57,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:10:57,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,463 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:57,463 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 23:10:57,463 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,463 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,463 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-18 23:10:57,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,464 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-18 23:10:57,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-18 23:10:57,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,464 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,464 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-18 23:10:57,464 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 23:10:57,464 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-18 23:10:57,466 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-18 23:10:57,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-18 23:10:57,466 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-18 23:10:57,466 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,466 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-18 23:10:57,466 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45431,1689721809599' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-18 23:10:57,466 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-18 23:10:57,466 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 23:10:57,468 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:57,468 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:57,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:10:57,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:10:57,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:10:57,468 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,469 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 23:10:57,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:10:57,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:57,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:10:57,470 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45431,1689721809599' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-18 23:10:57,470 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@546d9ab0[Count = 1] remaining members to acquire global barrier 2023-07-18 23:10:57,473 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-18 23:10:57,473 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,473 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-18 23:10:57,473 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-18 23:10:57,473 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45387,1689721809516' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-18 23:10:57,473 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 23:10:57,478 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-18 23:10:57,478 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-18 23:10:57,478 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38625,1689721809654' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-18 23:10:57,480 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,480 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,480 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:57,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:57,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:10:57,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:10:57,480 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,480 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 23:10:57,480 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,480 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 23:10:57,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:10:57,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:10:57,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:57,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:57,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:57,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:10:57,483 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38625,1689721809654' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-18 23:10:57,483 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@546d9ab0[Count = 0] remaining members to acquire global barrier 2023-07-18 23:10:57,483 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-18 23:10:57,483 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,484 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,484 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,484 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,485 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-18 23:10:57,485 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,484 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:57,485 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 23:10:57,485 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 23:10:57,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,485 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689721856288.74a5581cc1bcad54e4de2da1b36f3fad. 2023-07-18 23:10:57,485 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-18 23:10:57,485 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:57,485 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 23:10:57,485 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-18 23:10:57,485 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689721856288.74a5581cc1bcad54e4de2da1b36f3fad. started... 2023-07-18 23:10:57,485 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-18 23:10:57,485 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45387,1689721809516' in zk 2023-07-18 23:10:57,485 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 23:10:57,485 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 23:10:57,486 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689721856288.793a1e99e6874a89ce1e013596e47890. 2023-07-18 23:10:57,486 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 74a5581cc1bcad54e4de2da1b36f3fad: 2023-07-18 23:10:57,486 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689721856288.793a1e99e6874a89ce1e013596e47890. started... 2023-07-18 23:10:57,487 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689721856288.74a5581cc1bcad54e4de2da1b36f3fad.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,487 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 793a1e99e6874a89ce1e013596e47890: 2023-07-18 23:10:57,487 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 23:10:57,488 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 23:10:57,488 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689721856288.793a1e99e6874a89ce1e013596e47890.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,488 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 23:10:57,488 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 23:10:57,495 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-18 23:10:57,495 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 23:10:57,495 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-18 23:10:57,507 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689721856288.793a1e99e6874a89ce1e013596e47890. completed. 2023-07-18 23:10:57,507 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689721856288.793a1e99e6874a89ce1e013596e47890. 2023-07-18 23:10:57,507 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 23:10:57,507 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 23:10:57,507 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:57,507 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-18 23:10:57,507 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,38625,1689721809654' in zk 2023-07-18 23:10:57,510 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-18 23:10:57,510 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:57,510 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 23:10:57,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:57,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:10:57,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:10:57,510 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689721856288.74a5581cc1bcad54e4de2da1b36f3fad. completed. 2023-07-18 23:10:57,510 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-18 23:10:57,511 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689721856288.74a5581cc1bcad54e4de2da1b36f3fad. 2023-07-18 23:10:57,511 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 23:10:57,511 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 23:10:57,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:10:57,511 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:57,512 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-18 23:10:57,512 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45431,1689721809599' in zk 2023-07-18 23:10:57,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:10:57,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,513 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-18 23:10:57,513 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:57,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:57,514 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 23:10:57,514 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-18 23:10:57,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:57,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:57,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:10:57,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:57,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:57,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:57,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,38625,1689721809654': 2023-07-18 23:10:57,517 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38625,1689721809654' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-18 23:10:57,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:57,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:10:57,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:10:57,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:10:57,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:10:57,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:57,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:57,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:57,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:10:57,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:57,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:57,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:57,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,45431,1689721809599': 2023-07-18 23:10:57,520 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45431,1689721809599' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-18 23:10:57,520 INFO [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-18 23:10:57,520 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 23:10:57,520 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 23:10:57,520 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,520 INFO [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 23:10:57,522 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,522 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,522 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:10:57,522 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,522 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:10:57,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:10:57,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:10:57,522 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,523 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:57,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:10:57,523 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:10:57,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:10:57,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:10:57,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:10:57,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:10:57,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:10:57,524 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:57,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:10:57,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:10:57,525 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:57,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:57,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:57,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:57,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:10:57,527 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:57,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,527 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:57,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:57,527 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:57,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:57,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:57,531 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:57,531 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:10:57,531 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,531 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:10:57,532 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:10:57,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:10:57,532 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:10:57,532 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:57,532 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:10:57,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:10:57,532 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,532 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 23:10:57,532 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:57,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:10:57,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:10:57,532 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:10:57,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:10:57,532 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,532 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:10:57,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:10:57,533 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:57,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:10:57,534 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:10:57,534 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:57,534 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:57,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:10:57,534 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:10:57,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:10:57,534 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,534 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,540 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 23:10:57,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-18 23:10:57,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-18 23:10:57,541 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 23:10:57,556 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,578 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-18 23:10:57,578 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,578 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-18 23:10:57,578 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689721857439Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689721857532 (+93 ms)Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689721857534 (+2 ms)Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689721857538 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689721857550 (+12 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689721857578 (+28 ms) 2023-07-18 23:10:57,583 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-18 23:10:57,585 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 143 msec 2023-07-18 23:10:57,742 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 23:10:57,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-18 23:10:57,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 23:10:57,761 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45431] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689721856288.74a5581cc1bcad54e4de2da1b36f3fad. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 23:10:57,763 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38625] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689721856288.793a1e99e6874a89ce1e013596e47890. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 23:10:57,766 DEBUG [Listener at jenkins-hbase4.apache.org/33217] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-18 23:10:57,766 DEBUG [Listener at jenkins-hbase4.apache.org/33217] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689721856288.793a1e99e6874a89ce1e013596e47890. 2023-07-18 23:10:57,766 INFO [Listener at jenkins-hbase4.apache.org/33217] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 23:10:57,784 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-18 23:10:57,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689721857784 (current time:1689721857784). 2023-07-18 23:10:57,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 23:10:57,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(139): Connect 0x61cec439 to 127.0.0.1:61306 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 23:10:57,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@135e5a6b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 23:10:57,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 23:10:57,804 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46984, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 23:10:57,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x61cec439 to 127.0.0.1:61306 2023-07-18 23:10:57,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 23:10:57,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(139): Connect 0x75b9331f to 127.0.0.1:61306 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 23:10:57,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@62c1ce9d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 23:10:57,823 DEBUG [hconnection-0x32d4dac-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 23:10:57,824 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46986, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 23:10:57,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x75b9331f to 127.0.0.1:61306 2023-07-18 23:10:57,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 23:10:57,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-18 23:10:57,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 23:10:57,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-18 23:10:57,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-18 23:10:57,835 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-18 23:10:57,836 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689722457836 2023-07-18 23:10:57,836 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-18 23:10:57,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-18 23:10:57,838 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 23:10:57,838 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 23:10:57,838 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-18 23:10:57,839 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-18 23:10:57,841 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-07-18 23:10:57,842 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-18 23:10:57,847 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689722457847 2023-07-18 23:10:57,859 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-18 23:10:57,859 INFO [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-18 23:10:57,859 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 23:10:57,861 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-18 23:10:57,861 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-18 23:10:57,861 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 23:10:57,861 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 23:10:57,863 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:57,863 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:10:57,863 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:10:57,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:10:57,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:10:57,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:10:57,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:10:57,863 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:10:57,863 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:57,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:10:57,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:10:57,864 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:57,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 23:10:57,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 23:10:57,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 23:10:57,864 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:57,864 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 23:10:57,864 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 23:10:57,864 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 23:10:57,864 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 23:10:57,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-18 23:10:57,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-18 23:10:57,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-18 23:10:57,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 23:10:57,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 23:10:57,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 23:10:57,865 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-18 23:10:57,865 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-18 23:10:57,865 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-18 23:10:57,865 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-18 23:10:57,865 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-18 23:10:57,865 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-18 23:10:57,865 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-18 23:10:57,865 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 23:10:57,866 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-18 23:10:57,867 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-18 23:10:57,867 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 23:10:57,866 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-18 23:10:57,867 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 23:10:57,868 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-18 23:10:57,867 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-18 23:10:57,869 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-18 23:10:57,869 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-18 23:10:57,870 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-18 23:10:57,870 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45387,1689721809516' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-18 23:10:57,870 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45431,1689721809599' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-18 23:10:57,870 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38625,1689721809654' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-18 23:10:57,872 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 23:10:57,873 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 23:10:57,873 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 23:10:57,873 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 23:10:57,873 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 23:10:57,873 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:57,873 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:57,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:57,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:10:57,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:10:57,873 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 23:10:57,873 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 23:10:57,873 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 23:10:57,873 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 23:10:57,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:10:57,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:10:57,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 23:10:57,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:57,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:57,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:57,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:10:57,876 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38625,1689721809654' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-18 23:10:57,876 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46a7d9c9[Count = 1] remaining members to acquire global barrier 2023-07-18 23:10:57,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:57,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:10:57,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:10:57,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:10:57,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:10:57,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 23:10:57,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:57,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:57,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:57,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:10:57,878 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45431,1689721809599' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-18 23:10:57,878 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46a7d9c9[Count = 0] remaining members to acquire global barrier 2023-07-18 23:10:57,878 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-18 23:10:57,878 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 23:10:57,880 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 23:10:57,880 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 23:10:57,880 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 23:10:57,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 23:10:57,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 23:10:57,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 23:10:57,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 23:10:57,881 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:57,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 23:10:57,881 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-18 23:10:57,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 23:10:57,881 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-18 23:10:57,881 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-18 23:10:57,881 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-18 23:10:57,881 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 23:10:57,881 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689721856288.793a1e99e6874a89ce1e013596e47890. 2023-07-18 23:10:57,881 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:57,881 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689721856288.74a5581cc1bcad54e4de2da1b36f3fad. 2023-07-18 23:10:57,881 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 23:10:57,881 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689721856288.793a1e99e6874a89ce1e013596e47890. started... 2023-07-18 23:10:57,881 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 23:10:57,882 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 23:10:57,881 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 23:10:57,881 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45387,1689721809516' in zk 2023-07-18 23:10:57,882 INFO [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 793a1e99e6874a89ce1e013596e47890 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-18 23:10:57,882 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689721856288.74a5581cc1bcad54e4de2da1b36f3fad. started... 2023-07-18 23:10:57,882 INFO [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 74a5581cc1bcad54e4de2da1b36f3fad 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-18 23:10:57,885 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-18 23:10:57,885 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 23:10:57,885 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-18 23:10:57,902 INFO [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testConsecutiveExports/793a1e99e6874a89ce1e013596e47890/.tmp/cf/acc6f350fb0140c39e8d49632b9ee2b0 2023-07-18 23:10:57,906 INFO [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testConsecutiveExports/74a5581cc1bcad54e4de2da1b36f3fad/.tmp/cf/139dc651001b4eb0aa6447880ce2d2b3 2023-07-18 23:10:57,919 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testConsecutiveExports/793a1e99e6874a89ce1e013596e47890/.tmp/cf/acc6f350fb0140c39e8d49632b9ee2b0 as hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testConsecutiveExports/793a1e99e6874a89ce1e013596e47890/cf/acc6f350fb0140c39e8d49632b9ee2b0 2023-07-18 23:10:57,919 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testConsecutiveExports/74a5581cc1bcad54e4de2da1b36f3fad/.tmp/cf/139dc651001b4eb0aa6447880ce2d2b3 as hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testConsecutiveExports/74a5581cc1bcad54e4de2da1b36f3fad/cf/139dc651001b4eb0aa6447880ce2d2b3 2023-07-18 23:10:57,926 INFO [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testConsecutiveExports/74a5581cc1bcad54e4de2da1b36f3fad/cf/139dc651001b4eb0aa6447880ce2d2b3, entries=47, sequenceid=6, filesize=8.0 K 2023-07-18 23:10:57,926 INFO [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testConsecutiveExports/793a1e99e6874a89ce1e013596e47890/cf/acc6f350fb0140c39e8d49632b9ee2b0, entries=3, sequenceid=6, filesize=5.0 K 2023-07-18 23:10:57,927 INFO [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 793a1e99e6874a89ce1e013596e47890 in 45ms, sequenceid=6, compaction requested=false 2023-07-18 23:10:57,927 INFO [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 74a5581cc1bcad54e4de2da1b36f3fad in 45ms, sequenceid=6, compaction requested=false 2023-07-18 23:10:57,927 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-18 23:10:57,927 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-18 23:10:57,930 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 793a1e99e6874a89ce1e013596e47890: 2023-07-18 23:10:57,930 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 74a5581cc1bcad54e4de2da1b36f3fad: 2023-07-18 23:10:57,930 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689721856288.74a5581cc1bcad54e4de2da1b36f3fad.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-18 23:10:57,930 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689721856288.793a1e99e6874a89ce1e013596e47890.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-18 23:10:57,930 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 23:10:57,930 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 23:10:57,930 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testConsecutiveExports/74a5581cc1bcad54e4de2da1b36f3fad/cf/139dc651001b4eb0aa6447880ce2d2b3] hfiles 2023-07-18 23:10:57,930 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testConsecutiveExports/793a1e99e6874a89ce1e013596e47890/cf/acc6f350fb0140c39e8d49632b9ee2b0] hfiles 2023-07-18 23:10:57,930 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testConsecutiveExports/74a5581cc1bcad54e4de2da1b36f3fad/cf/139dc651001b4eb0aa6447880ce2d2b3 for snapshot=snaptb0-testConsecutiveExports 2023-07-18 23:10:57,930 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testConsecutiveExports/793a1e99e6874a89ce1e013596e47890/cf/acc6f350fb0140c39e8d49632b9ee2b0 for snapshot=snaptb0-testConsecutiveExports 2023-07-18 23:10:57,938 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 23:10:57,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-18 23:10:57,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-18 23:10:57,940 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 23:10:57,953 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689721856288.793a1e99e6874a89ce1e013596e47890. completed. 2023-07-18 23:10:57,954 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689721856288.793a1e99e6874a89ce1e013596e47890. 2023-07-18 23:10:57,954 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 23:10:57,954 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 23:10:57,954 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:57,954 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-18 23:10:57,954 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,38625,1689721809654' in zk 2023-07-18 23:10:57,956 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:57,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:57,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:10:57,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:10:57,956 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689721856288.74a5581cc1bcad54e4de2da1b36f3fad. completed. 2023-07-18 23:10:57,956 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-18 23:10:57,957 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 23:10:57,957 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689721856288.74a5581cc1bcad54e4de2da1b36f3fad. 2023-07-18 23:10:57,957 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-18 23:10:57,958 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 23:10:57,958 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 23:10:57,958 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:57,958 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-18 23:10:57,958 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45431,1689721809599' in zk 2023-07-18 23:10:57,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:10:57,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:10:57,960 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:57,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 23:10:57,961 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-18 23:10:57,961 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 23:10:57,961 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-18 23:10:57,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:57,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:57,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:57,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:10:57,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 23:10:57,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:57,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:57,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:57,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,38625,1689721809654': 2023-07-18 23:10:57,968 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38625,1689721809654' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-18 23:10:57,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:57,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:10:57,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:10:57,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:10:57,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:10:57,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 23:10:57,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:57,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:57,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:57,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:10:57,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 23:10:57,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:57,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:57,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:57,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,45431,1689721809599': 2023-07-18 23:10:57,974 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45431,1689721809599' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-18 23:10:57,974 INFO [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-18 23:10:57,974 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 23:10:57,974 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 23:10:57,974 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-18 23:10:57,974 INFO [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 23:10:57,977 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 23:10:57,977 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 23:10:57,978 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:10:57,978 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:10:57,978 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 23:10:57,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 23:10:57,978 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 23:10:57,978 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:10:57,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 23:10:57,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 23:10:57,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:10:57,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:10:57,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 23:10:57,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 23:10:57,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 23:10:57,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 23:10:57,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:10:57,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:10:57,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:10:57,980 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:57,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:10:57,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:10:57,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 23:10:57,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 23:10:57,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:10:57,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:10:57,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 23:10:57,980 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:57,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 23:10:57,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:10:57,982 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:57,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 23:10:57,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:57,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:57,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:57,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:10:57,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 23:10:57,984 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:57,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:57,984 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:57,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:57,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:57,985 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:57,997 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:10:57,997 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:10:57,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:10:57,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:10:57,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:10:57,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:10:57,997 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:10:57,997 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:10:57,997 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:57,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:10:57,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:10:57,998 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-18 23:10:57,998 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 23:10:57,998 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-18 23:10:57,998 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:57,998 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:10:57,997 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:10:57,998 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:57,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:10:57,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:10:57,998 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 23:10:57,998 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 23:10:57,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:10:58,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:10:58,000 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:10:58,001 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 23:10:58,001 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:10:58,001 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:10:58,001 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-18 23:10:58,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:10:58,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:10:58,001 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 23:10:58,001 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 23:10:58,031 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-18 23:10:58,055 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-18 23:10:58,056 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-18 23:10:58,056 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-18 23:10:58,056 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689721857836Consolidate snapshot: snaptb0-testConsecutiveExports at 1689721857998 (+162 ms)Loading Region manifests for snaptb0-testConsecutiveExports at 1689721857998Writing data manifest for snaptb0-testConsecutiveExports at 1689721858005 (+7 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689721858023 (+18 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689721858055 (+32 ms) 2023-07-18 23:10:58,059 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-18 23:10:58,061 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 222 msec 2023-07-18 23:10:58,140 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 23:10:58,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-18 23:10:58,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 23:10:58,142 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/local-export-1689721858141 2023-07-18 23:10:58,142 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/local-export-1689721858141, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/local-export-1689721858141, srcFsUri=hdfs://localhost:45655, srcDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054 2023-07-18 23:10:58,172 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45655, inputRoot=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054 2023-07-18 23:10:58,172 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@4ea989a4, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/local-export-1689721858141, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/local-export-1689721858141/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-18 23:10:58,172 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45655, inputRoot=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054, snapshotDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-18 23:10:58,182 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/local-export-1689721858141/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-18 23:10:58,198 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-18 23:10:58,198 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-18 23:10:58,199 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-18 23:10:58,200 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-18 23:10:59,140 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/hadoop-8512246336323508242.jar 2023-07-18 23:10:59,141 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-18 23:10:59,141 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-18 23:10:59,229 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/hadoop-5750451178896590163.jar 2023-07-18 23:10:59,230 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-18 23:10:59,230 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-18 23:10:59,231 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-18 23:10:59,231 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-18 23:10:59,231 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-18 23:10:59,232 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-18 23:10:59,232 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-18 23:10:59,232 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-18 23:10:59,233 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-18 23:10:59,233 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-18 23:10:59,234 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-18 23:10:59,234 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-18 23:10:59,234 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-18 23:10:59,235 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-18 23:10:59,235 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-18 23:10:59,236 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-18 23:10:59,236 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 23:10:59,237 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 23:10:59,237 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 23:10:59,237 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 23:10:59,238 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 23:10:59,238 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 23:10:59,239 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 23:10:59,754 WARN [Listener at jenkins-hbase4.apache.org/33217] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-18 23:10:59,756 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-18 23:10:59,758 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-18 23:11:00,044 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 23:11:00,044 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 23:11:00,050 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689721818645_0002_000001 (auth:SIMPLE) 2023-07-18 23:11:00,741 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689721818645_0003_000001 (auth:SIMPLE) 2023-07-18 23:11:01,578 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 23:11:05,264 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689721818645_0003_000001 (auth:SIMPLE) 2023-07-18 23:11:07,528 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689721818645_0003_000001 (auth:SIMPLE) 2023-07-18 23:11:10,124 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689721818645_0003_000001 (auth:SIMPLE) 2023-07-18 23:11:11,948 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-18 23:11:11,948 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-18 23:11:11,952 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-18 23:11:11,952 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-18 23:11:11,953 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-18 23:11:11,953 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-702194233_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-18 23:11:11,955 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(367): hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-18 23:11:11,955 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(367): hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-18 23:11:11,955 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@5fef3997 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/local-export-1689721858141/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/local-export-1689721858141/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-18 23:11:11,955 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/local-export-1689721858141/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-18 23:11:11,956 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/local-export-1689721858141/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-18 23:11:11,957 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/local-export-1689721858141, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/local-export-1689721858141, srcFsUri=hdfs://localhost:45655, srcDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054 2023-07-18 23:11:11,981 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45655, inputRoot=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054 2023-07-18 23:11:11,981 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@1565293b, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/local-export-1689721858141, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/local-export-1689721858141/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-18 23:11:11,981 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45655, inputRoot=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054, snapshotDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-18 23:11:11,991 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/local-export-1689721858141/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-18 23:11:12,003 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-18 23:11:12,003 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-18 23:11:12,004 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-18 23:11:12,004 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-18 23:11:12,896 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/hadoop-6410266997208242419.jar 2023-07-18 23:11:12,897 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-18 23:11:12,897 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-18 23:11:12,963 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/hadoop-4865963075752812632.jar 2023-07-18 23:11:12,964 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-18 23:11:12,964 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-18 23:11:12,965 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-18 23:11:12,965 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-18 23:11:12,966 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-18 23:11:12,966 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-18 23:11:12,966 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-18 23:11:12,967 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-18 23:11:12,967 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-18 23:11:12,967 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-18 23:11:12,968 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-18 23:11:12,968 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-18 23:11:12,969 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-18 23:11:12,969 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-18 23:11:12,969 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-18 23:11:12,970 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-18 23:11:12,970 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 23:11:12,971 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 23:11:12,971 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 23:11:12,971 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 23:11:12,972 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 23:11:12,972 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 23:11:12,973 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 23:11:13,341 WARN [Listener at jenkins-hbase4.apache.org/33217] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-18 23:11:13,343 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-18 23:11:13,345 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-18 23:11:16,297 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 23:11:16,297 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 23:11:16,300 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689721818645_0003_000001 (auth:SIMPLE) 2023-07-18 23:11:17,062 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689721818645_0004_000001 (auth:SIMPLE) 2023-07-18 23:11:21,285 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689721818645_0004_000001 (auth:SIMPLE) 2023-07-18 23:11:23,543 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689721818645_0004_000001 (auth:SIMPLE) 2023-07-18 23:11:26,214 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689721818645_0004_000001 (auth:SIMPLE) 2023-07-18 23:11:27,545 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-18 23:11:27,545 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-18 23:11:27,551 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-18 23:11:27,552 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-18 23:11:27,552 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-18 23:11:27,552 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-702194233_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-18 23:11:27,556 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(367): hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-18 23:11:27,556 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(367): hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-18 23:11:27,556 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@5fef3997 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/local-export-1689721858141/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/local-export-1689721858141/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-18 23:11:27,557 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/local-export-1689721858141/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-18 23:11:27,557 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/local-export-1689721858141/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-18 23:11:27,573 INFO [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-18 23:11:27,573 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-18 23:11:27,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-18 23:11:27,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-18 23:11:27,583 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689721887583"}]},"ts":"1689721887583"} 2023-07-18 23:11:27,586 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-18 23:11:27,588 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-18 23:11:27,590 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=793a1e99e6874a89ce1e013596e47890, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=74a5581cc1bcad54e4de2da1b36f3fad, UNASSIGN}] 2023-07-18 23:11:27,591 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=74a5581cc1bcad54e4de2da1b36f3fad, UNASSIGN 2023-07-18 23:11:27,593 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=793a1e99e6874a89ce1e013596e47890, UNASSIGN 2023-07-18 23:11:27,594 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=74a5581cc1bcad54e4de2da1b36f3fad, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:27,595 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689721856288.74a5581cc1bcad54e4de2da1b36f3fad.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689721887594"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689721887594"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689721887594"}]},"ts":"1689721887594"} 2023-07-18 23:11:27,595 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=793a1e99e6874a89ce1e013596e47890, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:27,595 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689721856288.793a1e99e6874a89ce1e013596e47890.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689721887595"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689721887595"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689721887595"}]},"ts":"1689721887595"} 2023-07-18 23:11:27,597 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure 74a5581cc1bcad54e4de2da1b36f3fad, server=jenkins-hbase4.apache.org,45431,1689721809599}] 2023-07-18 23:11:27,598 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure 793a1e99e6874a89ce1e013596e47890, server=jenkins-hbase4.apache.org,38625,1689721809654}] 2023-07-18 23:11:27,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-18 23:11:27,750 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 74a5581cc1bcad54e4de2da1b36f3fad 2023-07-18 23:11:27,750 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 74a5581cc1bcad54e4de2da1b36f3fad, disabling compactions & flushes 2023-07-18 23:11:27,750 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689721856288.74a5581cc1bcad54e4de2da1b36f3fad. 2023-07-18 23:11:27,750 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689721856288.74a5581cc1bcad54e4de2da1b36f3fad. 2023-07-18 23:11:27,750 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689721856288.74a5581cc1bcad54e4de2da1b36f3fad. after waiting 0 ms 2023-07-18 23:11:27,750 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689721856288.74a5581cc1bcad54e4de2da1b36f3fad. 2023-07-18 23:11:27,753 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 793a1e99e6874a89ce1e013596e47890 2023-07-18 23:11:27,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 793a1e99e6874a89ce1e013596e47890, disabling compactions & flushes 2023-07-18 23:11:27,753 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689721856288.793a1e99e6874a89ce1e013596e47890. 2023-07-18 23:11:27,754 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689721856288.793a1e99e6874a89ce1e013596e47890. 2023-07-18 23:11:27,754 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689721856288.793a1e99e6874a89ce1e013596e47890. after waiting 0 ms 2023-07-18 23:11:27,754 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689721856288.793a1e99e6874a89ce1e013596e47890. 2023-07-18 23:11:27,879 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testConsecutiveExports/793a1e99e6874a89ce1e013596e47890/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 23:11:27,880 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testConsecutiveExports/74a5581cc1bcad54e4de2da1b36f3fad/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 23:11:27,880 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 23:11:27,890 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689721856288.793a1e99e6874a89ce1e013596e47890. 2023-07-18 23:11:27,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 793a1e99e6874a89ce1e013596e47890: 2023-07-18 23:11:27,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 23:11:27,900 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689721856288.74a5581cc1bcad54e4de2da1b36f3fad. 2023-07-18 23:11:27,900 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 74a5581cc1bcad54e4de2da1b36f3fad: 2023-07-18 23:11:27,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-18 23:11:27,902 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 793a1e99e6874a89ce1e013596e47890 2023-07-18 23:11:27,906 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 74a5581cc1bcad54e4de2da1b36f3fad 2023-07-18 23:11:27,906 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=793a1e99e6874a89ce1e013596e47890, regionState=CLOSED 2023-07-18 23:11:27,906 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689721856288.793a1e99e6874a89ce1e013596e47890.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689721887906"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689721887906"}]},"ts":"1689721887906"} 2023-07-18 23:11:27,910 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=74a5581cc1bcad54e4de2da1b36f3fad, regionState=CLOSED 2023-07-18 23:11:27,910 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689721856288.74a5581cc1bcad54e4de2da1b36f3fad.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689721887910"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689721887910"}]},"ts":"1689721887910"} 2023-07-18 23:11:27,915 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-18 23:11:27,915 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure 793a1e99e6874a89ce1e013596e47890, server=jenkins-hbase4.apache.org,38625,1689721809654 in 311 msec 2023-07-18 23:11:27,918 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-18 23:11:27,918 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure 74a5581cc1bcad54e4de2da1b36f3fad, server=jenkins-hbase4.apache.org,45431,1689721809599 in 316 msec 2023-07-18 23:11:27,919 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=793a1e99e6874a89ce1e013596e47890, UNASSIGN in 325 msec 2023-07-18 23:11:27,921 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-18 23:11:27,921 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=74a5581cc1bcad54e4de2da1b36f3fad, UNASSIGN in 328 msec 2023-07-18 23:11:27,922 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689721887922"}]},"ts":"1689721887922"} 2023-07-18 23:11:27,924 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-18 23:11:27,931 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-18 23:11:27,934 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 359 msec 2023-07-18 23:11:28,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-18 23:11:28,203 INFO [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-18 23:11:28,204 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-18 23:11:28,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-18 23:11:28,209 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-18 23:11:28,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-18 23:11:28,211 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-18 23:11:28,212 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45387] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-18 23:11:28,219 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-18 23:11:28,219 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-18 23:11:28,220 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-18 23:11:28,220 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-18 23:11:28,220 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-18 23:11:28,221 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-18 23:11:28,221 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-18 23:11:28,222 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-18 23:11:28,224 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-18 23:11:28,224 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 23:11:28,224 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-18 23:11:28,224 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-18 23:11:28,224 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 23:11:28,224 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testConsecutiveExports/74a5581cc1bcad54e4de2da1b36f3fad 2023-07-18 23:11:28,224 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 23:11:28,224 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-18 23:11:28,225 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 23:11:28,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-18 23:11:28,227 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testConsecutiveExports/793a1e99e6874a89ce1e013596e47890 2023-07-18 23:11:28,229 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testConsecutiveExports/74a5581cc1bcad54e4de2da1b36f3fad/cf, FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testConsecutiveExports/74a5581cc1bcad54e4de2da1b36f3fad/recovered.edits] 2023-07-18 23:11:28,230 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testConsecutiveExports/793a1e99e6874a89ce1e013596e47890/cf, FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testConsecutiveExports/793a1e99e6874a89ce1e013596e47890/recovered.edits] 2023-07-18 23:11:28,240 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testConsecutiveExports/793a1e99e6874a89ce1e013596e47890/cf/acc6f350fb0140c39e8d49632b9ee2b0 to hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/archive/data/default/testtb-testConsecutiveExports/793a1e99e6874a89ce1e013596e47890/cf/acc6f350fb0140c39e8d49632b9ee2b0 2023-07-18 23:11:28,245 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testConsecutiveExports/793a1e99e6874a89ce1e013596e47890/recovered.edits/9.seqid to hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/archive/data/default/testtb-testConsecutiveExports/793a1e99e6874a89ce1e013596e47890/recovered.edits/9.seqid 2023-07-18 23:11:28,246 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testConsecutiveExports/793a1e99e6874a89ce1e013596e47890 2023-07-18 23:11:28,249 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testConsecutiveExports/74a5581cc1bcad54e4de2da1b36f3fad/cf/139dc651001b4eb0aa6447880ce2d2b3 to hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/archive/data/default/testtb-testConsecutiveExports/74a5581cc1bcad54e4de2da1b36f3fad/cf/139dc651001b4eb0aa6447880ce2d2b3 2023-07-18 23:11:28,253 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testConsecutiveExports/74a5581cc1bcad54e4de2da1b36f3fad/recovered.edits/9.seqid to hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/archive/data/default/testtb-testConsecutiveExports/74a5581cc1bcad54e4de2da1b36f3fad/recovered.edits/9.seqid 2023-07-18 23:11:28,254 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testConsecutiveExports/74a5581cc1bcad54e4de2da1b36f3fad 2023-07-18 23:11:28,254 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-18 23:11:28,258 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-18 23:11:28,279 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-18 23:11:28,288 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-18 23:11:28,290 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-18 23:11:28,290 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-18 23:11:28,290 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689721856288.793a1e99e6874a89ce1e013596e47890.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689721888290"}]},"ts":"9223372036854775807"} 2023-07-18 23:11:28,290 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689721856288.74a5581cc1bcad54e4de2da1b36f3fad.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689721888290"}]},"ts":"9223372036854775807"} 2023-07-18 23:11:28,294 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-18 23:11:28,294 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 793a1e99e6874a89ce1e013596e47890, NAME => 'testtb-testConsecutiveExports,,1689721856288.793a1e99e6874a89ce1e013596e47890.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 74a5581cc1bcad54e4de2da1b36f3fad, NAME => 'testtb-testConsecutiveExports,1,1689721856288.74a5581cc1bcad54e4de2da1b36f3fad.', STARTKEY => '1', ENDKEY => ''}] 2023-07-18 23:11:28,294 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-18 23:11:28,295 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689721888294"}]},"ts":"9223372036854775807"} 2023-07-18 23:11:28,312 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-18 23:11:28,318 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-18 23:11:28,325 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 114 msec 2023-07-18 23:11:28,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-18 23:11:28,328 INFO [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-18 23:11:28,338 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-18 23:11:28,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-18 23:11:28,342 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-18 23:11:28,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-18 23:11:28,393 INFO [Listener at jenkins-hbase4.apache.org/33217] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=748 (was 767), OpenFileDescriptor=895 (was 916), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=409 (was 382) - SystemLoadAverage LEAK? -, ProcessCount=185 (was 183) - ProcessCount LEAK? -, AvailableMemoryMB=2845 (was 2601) - AvailableMemoryMB LEAK? - 2023-07-18 23:11:28,393 WARN [Listener at jenkins-hbase4.apache.org/33217] hbase.ResourceChecker(130): Thread=748 is superior to 500 2023-07-18 23:11:28,419 INFO [Listener at jenkins-hbase4.apache.org/33217] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=748, OpenFileDescriptor=895, MaxFileDescriptor=60000, SystemLoadAverage=409, ProcessCount=185, AvailableMemoryMB=2843 2023-07-18 23:11:28,419 WARN [Listener at jenkins-hbase4.apache.org/33217] hbase.ResourceChecker(130): Thread=748 is superior to 500 2023-07-18 23:11:28,421 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-18 23:11:28,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:28,427 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 23:11:28,430 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-18 23:11:28,430 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 23:11:28,434 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/dd5a0ddce4f156e9f2bfe2ca38db9479 2023-07-18 23:11:28,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-18 23:11:28,447 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/12791e0779a2553cc33b5959e56831d4 2023-07-18 23:11:28,447 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/dd5a0ddce4f156e9f2bfe2ca38db9479 empty. 2023-07-18 23:11:28,448 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/dd5a0ddce4f156e9f2bfe2ca38db9479 2023-07-18 23:11:28,448 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/12791e0779a2553cc33b5959e56831d4 empty. 2023-07-18 23:11:28,448 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/12791e0779a2553cc33b5959e56831d4 2023-07-18 23:11:28,448 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-18 23:11:28,499 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-18 23:11:28,519 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => dd5a0ddce4f156e9f2bfe2ca38db9479, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689721888421.dd5a0ddce4f156e9f2bfe2ca38db9479.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp 2023-07-18 23:11:28,526 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 12791e0779a2553cc33b5959e56831d4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689721888421.12791e0779a2553cc33b5959e56831d4.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp 2023-07-18 23:11:28,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-18 23:11:28,605 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689721888421.dd5a0ddce4f156e9f2bfe2ca38db9479.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 23:11:28,605 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing dd5a0ddce4f156e9f2bfe2ca38db9479, disabling compactions & flushes 2023-07-18 23:11:28,605 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689721888421.dd5a0ddce4f156e9f2bfe2ca38db9479. 2023-07-18 23:11:28,605 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689721888421.dd5a0ddce4f156e9f2bfe2ca38db9479. 2023-07-18 23:11:28,605 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689721888421.dd5a0ddce4f156e9f2bfe2ca38db9479. after waiting 0 ms 2023-07-18 23:11:28,606 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689721888421.dd5a0ddce4f156e9f2bfe2ca38db9479. 2023-07-18 23:11:28,606 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689721888421.dd5a0ddce4f156e9f2bfe2ca38db9479. 2023-07-18 23:11:28,606 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for dd5a0ddce4f156e9f2bfe2ca38db9479: 2023-07-18 23:11:28,639 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689721888421.12791e0779a2553cc33b5959e56831d4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 23:11:28,639 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 12791e0779a2553cc33b5959e56831d4, disabling compactions & flushes 2023-07-18 23:11:28,639 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689721888421.12791e0779a2553cc33b5959e56831d4. 2023-07-18 23:11:28,639 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689721888421.12791e0779a2553cc33b5959e56831d4. 2023-07-18 23:11:28,639 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689721888421.12791e0779a2553cc33b5959e56831d4. after waiting 0 ms 2023-07-18 23:11:28,639 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689721888421.12791e0779a2553cc33b5959e56831d4. 2023-07-18 23:11:28,639 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689721888421.12791e0779a2553cc33b5959e56831d4. 2023-07-18 23:11:28,639 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 12791e0779a2553cc33b5959e56831d4: 2023-07-18 23:11:28,645 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 23:11:28,647 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689721888421.dd5a0ddce4f156e9f2bfe2ca38db9479.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689721888646"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689721888646"}]},"ts":"1689721888646"} 2023-07-18 23:11:28,647 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689721888421.12791e0779a2553cc33b5959e56831d4.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689721888646"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689721888646"}]},"ts":"1689721888646"} 2023-07-18 23:11:28,658 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-18 23:11:28,659 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 23:11:28,660 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689721888660"}]},"ts":"1689721888660"} 2023-07-18 23:11:28,663 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-18 23:11:28,668 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 23:11:28,670 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 23:11:28,670 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 23:11:28,670 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 23:11:28,670 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 23:11:28,671 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=dd5a0ddce4f156e9f2bfe2ca38db9479, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=12791e0779a2553cc33b5959e56831d4, ASSIGN}] 2023-07-18 23:11:28,674 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=12791e0779a2553cc33b5959e56831d4, ASSIGN 2023-07-18 23:11:28,674 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=dd5a0ddce4f156e9f2bfe2ca38db9479, ASSIGN 2023-07-18 23:11:28,675 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=dd5a0ddce4f156e9f2bfe2ca38db9479, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45431,1689721809599; forceNewPlan=false, retain=false 2023-07-18 23:11:28,675 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=12791e0779a2553cc33b5959e56831d4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38625,1689721809654; forceNewPlan=false, retain=false 2023-07-18 23:11:28,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-18 23:11:28,826 INFO [jenkins-hbase4:46651] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-18 23:11:28,828 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=12791e0779a2553cc33b5959e56831d4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:28,828 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=dd5a0ddce4f156e9f2bfe2ca38db9479, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:28,829 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689721888421.12791e0779a2553cc33b5959e56831d4.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689721888828"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689721888828"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689721888828"}]},"ts":"1689721888828"} 2023-07-18 23:11:28,829 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689721888421.dd5a0ddce4f156e9f2bfe2ca38db9479.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689721888828"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689721888828"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689721888828"}]},"ts":"1689721888828"} 2023-07-18 23:11:28,831 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 12791e0779a2553cc33b5959e56831d4, server=jenkins-hbase4.apache.org,38625,1689721809654}] 2023-07-18 23:11:28,832 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure dd5a0ddce4f156e9f2bfe2ca38db9479, server=jenkins-hbase4.apache.org,45431,1689721809599}] 2023-07-18 23:11:28,986 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689721888421.12791e0779a2553cc33b5959e56831d4. 2023-07-18 23:11:28,987 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 12791e0779a2553cc33b5959e56831d4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689721888421.12791e0779a2553cc33b5959e56831d4.', STARTKEY => '1', ENDKEY => ''} 2023-07-18 23:11:28,987 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689721888421.12791e0779a2553cc33b5959e56831d4. service=AccessControlService 2023-07-18 23:11:28,987 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689721888421.dd5a0ddce4f156e9f2bfe2ca38db9479. 2023-07-18 23:11:28,987 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 23:11:28,987 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dd5a0ddce4f156e9f2bfe2ca38db9479, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689721888421.dd5a0ddce4f156e9f2bfe2ca38db9479.', STARTKEY => '', ENDKEY => '1'} 2023-07-18 23:11:28,987 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 12791e0779a2553cc33b5959e56831d4 2023-07-18 23:11:28,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689721888421.dd5a0ddce4f156e9f2bfe2ca38db9479. service=AccessControlService 2023-07-18 23:11:28,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689721888421.12791e0779a2553cc33b5959e56831d4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 23:11:28,988 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 23:11:28,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 12791e0779a2553cc33b5959e56831d4 2023-07-18 23:11:28,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 12791e0779a2553cc33b5959e56831d4 2023-07-18 23:11:28,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion dd5a0ddce4f156e9f2bfe2ca38db9479 2023-07-18 23:11:28,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689721888421.dd5a0ddce4f156e9f2bfe2ca38db9479.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 23:11:28,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for dd5a0ddce4f156e9f2bfe2ca38db9479 2023-07-18 23:11:28,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for dd5a0ddce4f156e9f2bfe2ca38db9479 2023-07-18 23:11:28,991 INFO [StoreOpener-12791e0779a2553cc33b5959e56831d4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 12791e0779a2553cc33b5959e56831d4 2023-07-18 23:11:28,991 INFO [StoreOpener-dd5a0ddce4f156e9f2bfe2ca38db9479-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region dd5a0ddce4f156e9f2bfe2ca38db9479 2023-07-18 23:11:28,992 DEBUG [StoreOpener-12791e0779a2553cc33b5959e56831d4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion/12791e0779a2553cc33b5959e56831d4/cf 2023-07-18 23:11:28,992 DEBUG [StoreOpener-12791e0779a2553cc33b5959e56831d4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion/12791e0779a2553cc33b5959e56831d4/cf 2023-07-18 23:11:28,992 DEBUG [StoreOpener-dd5a0ddce4f156e9f2bfe2ca38db9479-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion/dd5a0ddce4f156e9f2bfe2ca38db9479/cf 2023-07-18 23:11:28,992 DEBUG [StoreOpener-dd5a0ddce4f156e9f2bfe2ca38db9479-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion/dd5a0ddce4f156e9f2bfe2ca38db9479/cf 2023-07-18 23:11:28,994 INFO [StoreOpener-12791e0779a2553cc33b5959e56831d4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 12791e0779a2553cc33b5959e56831d4 columnFamilyName cf 2023-07-18 23:11:28,994 INFO [StoreOpener-dd5a0ddce4f156e9f2bfe2ca38db9479-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dd5a0ddce4f156e9f2bfe2ca38db9479 columnFamilyName cf 2023-07-18 23:11:28,995 INFO [StoreOpener-12791e0779a2553cc33b5959e56831d4-1] regionserver.HStore(310): Store=12791e0779a2553cc33b5959e56831d4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 23:11:28,995 INFO [StoreOpener-dd5a0ddce4f156e9f2bfe2ca38db9479-1] regionserver.HStore(310): Store=dd5a0ddce4f156e9f2bfe2ca38db9479/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 23:11:28,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion/dd5a0ddce4f156e9f2bfe2ca38db9479 2023-07-18 23:11:28,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion/12791e0779a2553cc33b5959e56831d4 2023-07-18 23:11:28,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion/dd5a0ddce4f156e9f2bfe2ca38db9479 2023-07-18 23:11:28,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion/12791e0779a2553cc33b5959e56831d4 2023-07-18 23:11:29,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for dd5a0ddce4f156e9f2bfe2ca38db9479 2023-07-18 23:11:29,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 12791e0779a2553cc33b5959e56831d4 2023-07-18 23:11:29,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion/dd5a0ddce4f156e9f2bfe2ca38db9479/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 23:11:29,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion/12791e0779a2553cc33b5959e56831d4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 23:11:29,004 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened dd5a0ddce4f156e9f2bfe2ca38db9479; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64608145, jitterRate=-0.03726361691951752}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 23:11:29,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for dd5a0ddce4f156e9f2bfe2ca38db9479: 2023-07-18 23:11:29,004 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 12791e0779a2553cc33b5959e56831d4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72305840, jitterRate=0.07744097709655762}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 23:11:29,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 12791e0779a2553cc33b5959e56831d4: 2023-07-18 23:11:29,006 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689721888421.dd5a0ddce4f156e9f2bfe2ca38db9479., pid=61, masterSystemTime=1689721888984 2023-07-18 23:11:29,006 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689721888421.12791e0779a2553cc33b5959e56831d4., pid=60, masterSystemTime=1689721888983 2023-07-18 23:11:29,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689721888421.dd5a0ddce4f156e9f2bfe2ca38db9479. 2023-07-18 23:11:29,007 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689721888421.dd5a0ddce4f156e9f2bfe2ca38db9479. 2023-07-18 23:11:29,008 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=dd5a0ddce4f156e9f2bfe2ca38db9479, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:29,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689721888421.12791e0779a2553cc33b5959e56831d4. 2023-07-18 23:11:29,008 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689721888421.12791e0779a2553cc33b5959e56831d4. 2023-07-18 23:11:29,008 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689721888421.dd5a0ddce4f156e9f2bfe2ca38db9479.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689721889008"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689721889008"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689721889008"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689721889008"}]},"ts":"1689721889008"} 2023-07-18 23:11:29,008 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=12791e0779a2553cc33b5959e56831d4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:29,009 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689721888421.12791e0779a2553cc33b5959e56831d4.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689721889008"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689721889008"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689721889008"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689721889008"}]},"ts":"1689721889008"} 2023-07-18 23:11:29,013 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-18 23:11:29,013 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure dd5a0ddce4f156e9f2bfe2ca38db9479, server=jenkins-hbase4.apache.org,45431,1689721809599 in 178 msec 2023-07-18 23:11:29,014 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-18 23:11:29,014 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 12791e0779a2553cc33b5959e56831d4, server=jenkins-hbase4.apache.org,38625,1689721809654 in 179 msec 2023-07-18 23:11:29,015 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=dd5a0ddce4f156e9f2bfe2ca38db9479, ASSIGN in 342 msec 2023-07-18 23:11:29,018 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-18 23:11:29,018 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=12791e0779a2553cc33b5959e56831d4, ASSIGN in 343 msec 2023-07-18 23:11:29,020 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 23:11:29,020 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689721889020"}]},"ts":"1689721889020"} 2023-07-18 23:11:29,021 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-18 23:11:29,024 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 23:11:29,024 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-18 23:11:29,026 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45387] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-18 23:11:29,028 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 23:11:29,028 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 23:11:29,028 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 23:11:29,030 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 23:11:29,030 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 23:11:29,032 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 23:11:29,032 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 23:11:29,032 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 23:11:29,033 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 609 msec 2023-07-18 23:11:29,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-18 23:11:29,044 INFO [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-18 23:11:29,044 DEBUG [Listener at jenkins-hbase4.apache.org/33217] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithMergeRegion get assigned. Timeout = 60000ms 2023-07-18 23:11:29,044 INFO [Listener at jenkins-hbase4.apache.org/33217] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 23:11:29,046 INFO [Listener at jenkins-hbase4.apache.org/33217] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned to meta. Checking AM states. 2023-07-18 23:11:29,047 INFO [Listener at jenkins-hbase4.apache.org/33217] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 23:11:29,047 INFO [Listener at jenkins-hbase4.apache.org/33217] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned. 2023-07-18 23:11:29,049 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-18 23:11:29,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689721889049 (current time:1689721889049). 2023-07-18 23:11:29,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 23:11:29,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(139): Connect 0x1bf81a3d to 127.0.0.1:61306 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 23:11:29,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@109ce593, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 23:11:29,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 23:11:29,061 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51468, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 23:11:29,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1bf81a3d to 127.0.0.1:61306 2023-07-18 23:11:29,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 23:11:29,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(139): Connect 0x0298c7be to 127.0.0.1:61306 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 23:11:29,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@596a1c22, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 23:11:29,070 DEBUG [hconnection-0x2e2dcae1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 23:11:29,073 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51476, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 23:11:29,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0298c7be to 127.0.0.1:61306 2023-07-18 23:11:29,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 23:11:29,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-18 23:11:29,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 23:11:29,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-18 23:11:29,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-18 23:11:29,081 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-18 23:11:29,082 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689722489082 2023-07-18 23:11:29,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-18 23:11:29,082 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,084 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 23:11:29,084 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 23:11:29,084 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-18 23:11:29,085 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-18 23:11:29,087 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-07-18 23:11:29,087 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-18 23:11:29,089 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689722489089 2023-07-18 23:11:29,119 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,119 INFO [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-18 23:11:29,119 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 23:11:29,121 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-18 23:11:29,121 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-18 23:11:29,121 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,121 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,123 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:11:29,123 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:11:29,123 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:29,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:11:29,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:11:29,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:11:29,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:11:29,124 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:29,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,124 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:29,124 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,124 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-18 23:11:29,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-18 23:11:29,125 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-18 23:11:29,125 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:29,125 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 23:11:29,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,125 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-18 23:11:29,126 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:11:29,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:11:29,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:11:29,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,127 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-18 23:11:29,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,128 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-18 23:11:29,130 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,131 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-18 23:11:29,131 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 23:11:29,136 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-18 23:11:29,136 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-18 23:11:29,136 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38625,1689721809654' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-18 23:11:29,138 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,139 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-18 23:11:29,139 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 23:11:29,140 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-18 23:11:29,140 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-18 23:11:29,140 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45431,1689721809599' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-18 23:11:29,142 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,142 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-18 23:11:29,142 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 23:11:29,144 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-18 23:11:29,144 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-18 23:11:29,144 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45387,1689721809516' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-18 23:11:29,146 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:29,146 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:29,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:11:29,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:11:29,148 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,148 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:11:29,148 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 23:11:29,149 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:29,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:11:29,149 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,149 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 23:11:29,149 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,150 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,150 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 23:11:29,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:29,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:29,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:29,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:11:29,152 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38625,1689721809654' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-18 23:11:29,152 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4888655e[Count = 1] remaining members to acquire global barrier 2023-07-18 23:11:29,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:29,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:11:29,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:11:29,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:11:29,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:11:29,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:29,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:29,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:29,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:11:29,154 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45431,1689721809599' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-18 23:11:29,154 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4888655e[Count = 0] remaining members to acquire global barrier 2023-07-18 23:11:29,154 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-18 23:11:29,155 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,156 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,156 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,156 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,156 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-18 23:11:29,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,156 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:29,156 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-18 23:11:29,156 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-18 23:11:29,156 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45387,1689721809516' in zk 2023-07-18 23:11:29,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,156 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 23:11:29,156 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 23:11:29,157 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:29,157 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 23:11:29,156 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-18 23:11:29,157 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689721888421.12791e0779a2553cc33b5959e56831d4. 2023-07-18 23:11:29,157 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 23:11:29,157 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 23:11:29,157 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689721888421.12791e0779a2553cc33b5959e56831d4. started... 2023-07-18 23:11:29,157 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689721888421.dd5a0ddce4f156e9f2bfe2ca38db9479. 2023-07-18 23:11:29,158 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 12791e0779a2553cc33b5959e56831d4: 2023-07-18 23:11:29,160 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689721888421.dd5a0ddce4f156e9f2bfe2ca38db9479. started... 2023-07-18 23:11:29,160 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689721888421.12791e0779a2553cc33b5959e56831d4.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,161 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dd5a0ddce4f156e9f2bfe2ca38db9479: 2023-07-18 23:11:29,161 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 23:11:29,162 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 23:11:29,162 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689721888421.dd5a0ddce4f156e9f2bfe2ca38db9479.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,162 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 23:11:29,162 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 23:11:29,162 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-18 23:11:29,162 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 23:11:29,162 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-18 23:11:29,184 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 23:11:29,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-18 23:11:29,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-18 23:11:29,201 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 23:11:29,217 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689721888421.dd5a0ddce4f156e9f2bfe2ca38db9479. completed. 2023-07-18 23:11:29,218 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689721888421.dd5a0ddce4f156e9f2bfe2ca38db9479. 2023-07-18 23:11:29,218 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 23:11:29,218 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 23:11:29,218 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:29,225 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-18 23:11:29,225 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45431,1689721809599' in zk 2023-07-18 23:11:29,227 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-18 23:11:29,227 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 23:11:29,227 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:29,227 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-18 23:11:29,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:29,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:11:29,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:11:29,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:11:29,230 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689721888421.12791e0779a2553cc33b5959e56831d4. completed. 2023-07-18 23:11:29,230 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689721888421.12791e0779a2553cc33b5959e56831d4. 2023-07-18 23:11:29,230 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 23:11:29,230 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 23:11:29,230 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:29,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:11:29,230 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-18 23:11:29,231 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,38625,1689721809654' in zk 2023-07-18 23:11:29,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,233 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-18 23:11:29,233 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:29,233 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 23:11:29,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:29,234 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-18 23:11:29,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:29,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:29,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:11:29,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:29,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:29,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:29,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,45431,1689721809599': 2023-07-18 23:11:29,239 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45431,1689721809599' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-18 23:11:29,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:29,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:11:29,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:11:29,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:11:29,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:11:29,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:29,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:29,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:29,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:11:29,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:29,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:29,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:29,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,38625,1689721809654': 2023-07-18 23:11:29,245 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38625,1689721809654' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-18 23:11:29,245 INFO [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-18 23:11:29,245 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 23:11:29,245 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 23:11:29,245 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,245 INFO [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 23:11:29,247 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,247 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,247 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:11:29,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,247 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:11:29,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,248 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,248 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:11:29,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:11:29,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:11:29,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:11:29,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:11:29,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:11:29,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:11:29,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,250 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:11:29,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:11:29,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:11:29,251 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:29,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,253 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:29,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:11:29,254 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:29,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:29,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:29,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:29,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:11:29,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,256 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:29,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:29,264 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:29,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:29,264 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:29,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:29,276 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:29,277 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,277 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:11:29,277 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:11:29,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:11:29,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:11:29,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:11:29,277 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:11:29,277 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:11:29,277 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:29,277 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:11:29,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:11:29,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:11:29,277 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:11:29,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:11:29,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:11:29,277 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:29,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:11:29,277 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:11:29,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:11:29,277 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 23:11:29,278 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:11:29,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:11:29,278 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,280 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:29,280 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,280 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:29,280 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:29,280 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,280 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,281 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,326 WARN [DataStreamer for file /user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion/data.manifest] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-07-18 23:11:29,350 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,401 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 23:11:29,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-18 23:11:29,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-18 23:11:29,415 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-18 23:11:29,456 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-18 23:11:29,456 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,457 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,457 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689721889082Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689721889278 (+196 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689721889280 (+2 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689721889308 (+28 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689721889329 (+21 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689721889456 (+127 ms) 2023-07-18 23:11:29,461 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-18 23:11:29,463 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 377 msec 2023-07-18 23:11:29,716 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 23:11:29,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-18 23:11:29,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 23:11:29,727 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45431] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689721888421.dd5a0ddce4f156e9f2bfe2ca38db9479. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 23:11:29,732 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38625] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689721888421.12791e0779a2553cc33b5959e56831d4. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 23:11:29,735 DEBUG [Listener at jenkins-hbase4.apache.org/33217] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,735 DEBUG [Listener at jenkins-hbase4.apache.org/33217] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689721888421.dd5a0ddce4f156e9f2bfe2ca38db9479. 2023-07-18 23:11:29,735 INFO [Listener at jenkins-hbase4.apache.org/33217] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 23:11:29,751 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-18 23:11:29,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689721889751 (current time:1689721889751). 2023-07-18 23:11:29,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 23:11:29,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(139): Connect 0x3f6044f6 to 127.0.0.1:61306 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 23:11:29,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4254dc59, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 23:11:29,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 23:11:29,761 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51478, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 23:11:29,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3f6044f6 to 127.0.0.1:61306 2023-07-18 23:11:29,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 23:11:29,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(139): Connect 0x5f04a6aa to 127.0.0.1:61306 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 23:11:29,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@627e1e48, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 23:11:29,778 DEBUG [hconnection-0x6acb04a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 23:11:29,781 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51490, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 23:11:29,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5f04a6aa to 127.0.0.1:61306 2023-07-18 23:11:29,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 23:11:29,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-18 23:11:29,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 23:11:29,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-18 23:11:29,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-18 23:11:29,795 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-18 23:11:29,796 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689722489796 2023-07-18 23:11:29,796 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-18 23:11:29,797 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 23:11:29,797 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 23:11:29,797 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-18 23:11:29,798 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-18 23:11:29,799 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-07-18 23:11:29,800 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-18 23:11:29,800 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689722489800 2023-07-18 23:11:29,829 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,829 INFO [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-18 23:11:29,829 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 23:11:29,831 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-18 23:11:29,831 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-18 23:11:29,832 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,832 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,835 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:11:29,835 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:11:29,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:11:29,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:11:29,835 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:11:29,835 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:29,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:11:29,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:11:29,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:11:29,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:11:29,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,835 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:29,836 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:29,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,836 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,836 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,836 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:29,836 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 23:11:29,836 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-18 23:11:29,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-18 23:11:29,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-18 23:11:29,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,837 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-18 23:11:29,837 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-18 23:11:29,837 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-18 23:11:29,837 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,837 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,837 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-18 23:11:29,837 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-18 23:11:29,837 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,837 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 23:11:29,837 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-18 23:11:29,839 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-18 23:11:29,839 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-18 23:11:29,837 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 23:11:29,839 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38625,1689721809654' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-18 23:11:29,840 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-18 23:11:29,840 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-18 23:11:29,839 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 23:11:29,841 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45387,1689721809516' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-18 23:11:29,842 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-18 23:11:29,842 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-18 23:11:29,842 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45431,1689721809599' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-18 23:11:29,843 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,843 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:29,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:29,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:11:29,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:11:29,844 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,845 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,845 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,845 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 23:11:29,845 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 23:11:29,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:11:29,846 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:29,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:11:29,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:29,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:29,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:29,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:11:29,848 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38625,1689721809654' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-18 23:11:29,848 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7fd21dc4[Count = 1] remaining members to acquire global barrier 2023-07-18 23:11:29,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:29,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:11:29,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:11:29,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:11:29,848 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:11:29,848 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,848 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 23:11:29,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:29,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:29,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:29,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:11:29,850 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45431,1689721809599' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-18 23:11:29,850 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7fd21dc4[Count = 0] remaining members to acquire global barrier 2023-07-18 23:11:29,850 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-18 23:11:29,850 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,851 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,851 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,852 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,852 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:29,852 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-18 23:11:29,852 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-18 23:11:29,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,852 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45387,1689721809516' in zk 2023-07-18 23:11:29,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,852 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-18 23:11:29,852 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:29,852 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 23:11:29,852 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-18 23:11:29,852 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 23:11:29,852 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 23:11:29,852 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689721888421.dd5a0ddce4f156e9f2bfe2ca38db9479. 2023-07-18 23:11:29,852 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 23:11:29,853 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 23:11:29,853 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689721888421.12791e0779a2553cc33b5959e56831d4. 2023-07-18 23:11:29,853 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689721888421.dd5a0ddce4f156e9f2bfe2ca38db9479. started... 2023-07-18 23:11:29,853 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689721888421.12791e0779a2553cc33b5959e56831d4. started... 2023-07-18 23:11:29,853 INFO [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] regionserver.HRegion(2745): Flushing dd5a0ddce4f156e9f2bfe2ca38db9479 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-18 23:11:29,853 INFO [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 12791e0779a2553cc33b5959e56831d4 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-18 23:11:29,854 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-18 23:11:29,854 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 23:11:29,854 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-18 23:11:29,897 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 23:11:29,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-18 23:11:29,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-18 23:11:29,915 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 23:11:29,930 INFO [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion/12791e0779a2553cc33b5959e56831d4/.tmp/cf/d10504456a964868a2a5129ecc199bd6 2023-07-18 23:11:29,931 INFO [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion/dd5a0ddce4f156e9f2bfe2ca38db9479/.tmp/cf/337108349cc646299c915d68eda8862e 2023-07-18 23:11:29,942 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion/12791e0779a2553cc33b5959e56831d4/.tmp/cf/d10504456a964868a2a5129ecc199bd6 as hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion/12791e0779a2553cc33b5959e56831d4/cf/d10504456a964868a2a5129ecc199bd6 2023-07-18 23:11:29,948 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion/dd5a0ddce4f156e9f2bfe2ca38db9479/.tmp/cf/337108349cc646299c915d68eda8862e as hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion/dd5a0ddce4f156e9f2bfe2ca38db9479/cf/337108349cc646299c915d68eda8862e 2023-07-18 23:11:29,954 INFO [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion/12791e0779a2553cc33b5959e56831d4/cf/d10504456a964868a2a5129ecc199bd6, entries=48, sequenceid=6, filesize=8.1 K 2023-07-18 23:11:29,955 INFO [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 12791e0779a2553cc33b5959e56831d4 in 102ms, sequenceid=6, compaction requested=false 2023-07-18 23:11:29,955 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-18 23:11:29,956 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 12791e0779a2553cc33b5959e56831d4: 2023-07-18 23:11:29,956 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689721888421.12791e0779a2553cc33b5959e56831d4.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,956 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 23:11:29,956 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion/12791e0779a2553cc33b5959e56831d4/cf/d10504456a964868a2a5129ecc199bd6] hfiles 2023-07-18 23:11:29,956 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion/12791e0779a2553cc33b5959e56831d4/cf/d10504456a964868a2a5129ecc199bd6 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,961 INFO [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion/dd5a0ddce4f156e9f2bfe2ca38db9479/cf/337108349cc646299c915d68eda8862e, entries=2, sequenceid=6, filesize=5.0 K 2023-07-18 23:11:29,962 INFO [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for dd5a0ddce4f156e9f2bfe2ca38db9479 in 109ms, sequenceid=6, compaction requested=false 2023-07-18 23:11:29,966 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dd5a0ddce4f156e9f2bfe2ca38db9479: 2023-07-18 23:11:29,967 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689721888421.dd5a0ddce4f156e9f2bfe2ca38db9479.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,967 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 23:11:29,967 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion/dd5a0ddce4f156e9f2bfe2ca38db9479/cf/337108349cc646299c915d68eda8862e] hfiles 2023-07-18 23:11:29,967 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion/dd5a0ddce4f156e9f2bfe2ca38db9479/cf/337108349cc646299c915d68eda8862e for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:29,995 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689721888421.12791e0779a2553cc33b5959e56831d4. completed. 2023-07-18 23:11:29,995 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689721888421.12791e0779a2553cc33b5959e56831d4. 2023-07-18 23:11:29,995 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689721888421.dd5a0ddce4f156e9f2bfe2ca38db9479. completed. 2023-07-18 23:11:29,995 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 23:11:29,996 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 23:11:29,995 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689721888421.dd5a0ddce4f156e9f2bfe2ca38db9479. 2023-07-18 23:11:29,996 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:29,996 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 23:11:29,996 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 23:11:29,996 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:29,996 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-18 23:11:29,996 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45431,1689721809599' in zk 2023-07-18 23:11:29,996 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-18 23:11:29,996 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,38625,1689721809654' in zk 2023-07-18 23:11:29,998 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:29,998 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-18 23:11:29,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:29,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:11:29,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:11:29,998 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 23:11:29,998 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:29,998 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-18 23:11:29,998 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-18 23:11:30,000 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 23:11:30,000 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-18 23:11:30,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:11:30,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:11:30,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:30,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:30,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:30,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:30,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:11:30,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:30,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:30,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:30,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:30,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,45431,1689721809599': 2023-07-18 23:11:30,006 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45431,1689721809599' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-18 23:11:30,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:30,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:11:30,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:11:30,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:11:30,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:11:30,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:30,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:30,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:30,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:30,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:11:30,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:30,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:30,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:30,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:30,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,38625,1689721809654': 2023-07-18 23:11:30,012 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38625,1689721809654' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-18 23:11:30,012 INFO [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-18 23:11:30,012 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 23:11:30,012 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 23:11:30,012 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:30,012 INFO [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 23:11:30,023 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:30,023 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:30,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:30,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:30,024 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:11:30,024 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:30,024 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:11:30,023 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:30,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:30,024 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:11:30,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:30,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:30,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:30,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:30,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:11:30,024 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:30,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:11:30,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:11:30,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:11:30,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:11:30,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:11:30,025 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:30,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:11:30,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:11:30,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:30,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:11:30,025 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:30,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:30,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:30,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:30,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:11:30,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:30,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:30,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:30,027 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:30,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:30,028 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:30,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:11:30,028 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:30,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:30,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:30,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:30,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:30,032 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:11:30,032 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:11:30,032 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:11:30,032 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:11:30,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:11:30,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:11:30,032 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:11:30,032 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:11:30,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:11:30,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:11:30,032 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:30,033 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:30,033 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:30,033 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:30,033 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:30,033 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:30,033 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:30,033 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:30,033 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 23:11:30,033 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:30,033 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:30,033 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:30,033 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:30,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:11:30,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:11:30,040 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:30,040 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:30,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:11:30,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:11:30,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:11:30,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:11:30,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:11:30,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:11:30,088 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:30,116 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 23:11:30,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-18 23:11:30,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-18 23:11:30,117 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-18 23:11:30,135 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-18 23:11:30,135 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:30,136 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:30,136 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689721889796Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689721890033 (+237 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689721890033Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689721890047 (+14 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689721890080 (+33 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689721890135 (+55 ms) 2023-07-18 23:11:30,142 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-18 23:11:30,144 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 345 msec 2023-07-18 23:11:30,418 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 23:11:30,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-18 23:11:30,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 23:11:30,467 DEBUG [Listener at jenkins-hbase4.apache.org/33217] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-18 23:11:30,476 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38946, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-18 23:11:30,478 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38625] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-18 23:11:30,480 DEBUG [Listener at jenkins-hbase4.apache.org/33217] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-18 23:11:30,486 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56396, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-18 23:11:30,486 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45387] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-18 23:11:30,488 DEBUG [Listener at jenkins-hbase4.apache.org/33217] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-18 23:11:30,497 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46372, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-18 23:11:30,497 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45431] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-18 23:11:30,499 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-18 23:11:30,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:30,505 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 23:11:30,506 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-18 23:11:30,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-18 23:11:30,510 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 23:11:30,513 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7581d9896be97316f7e287ee44b68984 2023-07-18 23:11:30,513 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/17d1b54928d3d3ab5c91f9642d379a3f 2023-07-18 23:11:30,514 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7581d9896be97316f7e287ee44b68984 empty. 2023-07-18 23:11:30,514 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/17d1b54928d3d3ab5c91f9642d379a3f empty. 2023-07-18 23:11:30,514 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7581d9896be97316f7e287ee44b68984 2023-07-18 23:11:30,518 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/17d1b54928d3d3ab5c91f9642d379a3f 2023-07-18 23:11:30,519 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-18 23:11:30,578 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-18 23:11:30,583 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7581d9896be97316f7e287ee44b68984, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689721890499.7581d9896be97316f7e287ee44b68984.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp 2023-07-18 23:11:30,586 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 17d1b54928d3d3ab5c91f9642d379a3f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689721890499.17d1b54928d3d3ab5c91f9642d379a3f.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp 2023-07-18 23:11:30,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-18 23:11:30,612 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689721890499.7581d9896be97316f7e287ee44b68984.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 23:11:30,612 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 7581d9896be97316f7e287ee44b68984, disabling compactions & flushes 2023-07-18 23:11:30,612 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689721890499.7581d9896be97316f7e287ee44b68984. 2023-07-18 23:11:30,612 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689721890499.7581d9896be97316f7e287ee44b68984. 2023-07-18 23:11:30,612 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689721890499.7581d9896be97316f7e287ee44b68984. after waiting 0 ms 2023-07-18 23:11:30,612 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689721890499.7581d9896be97316f7e287ee44b68984. 2023-07-18 23:11:30,612 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689721890499.7581d9896be97316f7e287ee44b68984. 2023-07-18 23:11:30,612 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 7581d9896be97316f7e287ee44b68984: 2023-07-18 23:11:30,628 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689721890499.17d1b54928d3d3ab5c91f9642d379a3f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 23:11:30,628 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 17d1b54928d3d3ab5c91f9642d379a3f, disabling compactions & flushes 2023-07-18 23:11:30,628 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689721890499.17d1b54928d3d3ab5c91f9642d379a3f. 2023-07-18 23:11:30,628 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689721890499.17d1b54928d3d3ab5c91f9642d379a3f. 2023-07-18 23:11:30,628 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689721890499.17d1b54928d3d3ab5c91f9642d379a3f. after waiting 0 ms 2023-07-18 23:11:30,628 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689721890499.17d1b54928d3d3ab5c91f9642d379a3f. 2023-07-18 23:11:30,628 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689721890499.17d1b54928d3d3ab5c91f9642d379a3f. 2023-07-18 23:11:30,628 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 17d1b54928d3d3ab5c91f9642d379a3f: 2023-07-18 23:11:30,631 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 23:11:30,632 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689721890499.7581d9896be97316f7e287ee44b68984.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689721890632"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689721890632"}]},"ts":"1689721890632"} 2023-07-18 23:11:30,632 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689721890499.17d1b54928d3d3ab5c91f9642d379a3f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689721890632"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689721890632"}]},"ts":"1689721890632"} 2023-07-18 23:11:30,635 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-18 23:11:30,636 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 23:11:30,637 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689721890637"}]},"ts":"1689721890637"} 2023-07-18 23:11:30,641 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-18 23:11:30,646 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 23:11:30,648 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 23:11:30,648 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 23:11:30,648 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 23:11:30,648 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 23:11:30,649 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7581d9896be97316f7e287ee44b68984, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=17d1b54928d3d3ab5c91f9642d379a3f, ASSIGN}] 2023-07-18 23:11:30,652 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7581d9896be97316f7e287ee44b68984, ASSIGN 2023-07-18 23:11:30,652 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=17d1b54928d3d3ab5c91f9642d379a3f, ASSIGN 2023-07-18 23:11:30,653 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7581d9896be97316f7e287ee44b68984, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45387,1689721809516; forceNewPlan=false, retain=false 2023-07-18 23:11:30,653 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=17d1b54928d3d3ab5c91f9642d379a3f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45431,1689721809599; forceNewPlan=false, retain=false 2023-07-18 23:11:30,803 INFO [jenkins-hbase4:46651] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-18 23:11:30,807 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=17d1b54928d3d3ab5c91f9642d379a3f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:30,807 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689721890499.17d1b54928d3d3ab5c91f9642d379a3f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689721890807"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689721890807"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689721890807"}]},"ts":"1689721890807"} 2023-07-18 23:11:30,808 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=7581d9896be97316f7e287ee44b68984, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:30,808 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689721890499.7581d9896be97316f7e287ee44b68984.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689721890808"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689721890808"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689721890808"}]},"ts":"1689721890808"} 2023-07-18 23:11:30,814 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 17d1b54928d3d3ab5c91f9642d379a3f, server=jenkins-hbase4.apache.org,45431,1689721809599}] 2023-07-18 23:11:30,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-18 23:11:30,815 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure 7581d9896be97316f7e287ee44b68984, server=jenkins-hbase4.apache.org,45387,1689721809516}] 2023-07-18 23:11:30,977 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689721890499.17d1b54928d3d3ab5c91f9642d379a3f. 2023-07-18 23:11:30,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 17d1b54928d3d3ab5c91f9642d379a3f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689721890499.17d1b54928d3d3ab5c91f9642d379a3f.', STARTKEY => '2', ENDKEY => ''} 2023-07-18 23:11:30,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689721890499.17d1b54928d3d3ab5c91f9642d379a3f. service=AccessControlService 2023-07-18 23:11:30,978 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 23:11:30,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 17d1b54928d3d3ab5c91f9642d379a3f 2023-07-18 23:11:30,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689721890499.17d1b54928d3d3ab5c91f9642d379a3f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 23:11:30,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 17d1b54928d3d3ab5c91f9642d379a3f 2023-07-18 23:11:30,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 17d1b54928d3d3ab5c91f9642d379a3f 2023-07-18 23:11:30,983 INFO [StoreOpener-17d1b54928d3d3ab5c91f9642d379a3f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 17d1b54928d3d3ab5c91f9642d379a3f 2023-07-18 23:11:30,983 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689721890499.7581d9896be97316f7e287ee44b68984. 2023-07-18 23:11:30,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7581d9896be97316f7e287ee44b68984, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689721890499.7581d9896be97316f7e287ee44b68984.', STARTKEY => '', ENDKEY => '2'} 2023-07-18 23:11:30,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689721890499.7581d9896be97316f7e287ee44b68984. service=AccessControlService 2023-07-18 23:11:30,984 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 23:11:30,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 7581d9896be97316f7e287ee44b68984 2023-07-18 23:11:30,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689721890499.7581d9896be97316f7e287ee44b68984.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 23:11:30,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7581d9896be97316f7e287ee44b68984 2023-07-18 23:11:30,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7581d9896be97316f7e287ee44b68984 2023-07-18 23:11:30,986 INFO [StoreOpener-7581d9896be97316f7e287ee44b68984-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7581d9896be97316f7e287ee44b68984 2023-07-18 23:11:30,986 DEBUG [StoreOpener-17d1b54928d3d3ab5c91f9642d379a3f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/17d1b54928d3d3ab5c91f9642d379a3f/cf 2023-07-18 23:11:30,986 DEBUG [StoreOpener-17d1b54928d3d3ab5c91f9642d379a3f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/17d1b54928d3d3ab5c91f9642d379a3f/cf 2023-07-18 23:11:30,987 INFO [StoreOpener-17d1b54928d3d3ab5c91f9642d379a3f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 17d1b54928d3d3ab5c91f9642d379a3f columnFamilyName cf 2023-07-18 23:11:30,987 DEBUG [StoreOpener-7581d9896be97316f7e287ee44b68984-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7581d9896be97316f7e287ee44b68984/cf 2023-07-18 23:11:30,987 DEBUG [StoreOpener-7581d9896be97316f7e287ee44b68984-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7581d9896be97316f7e287ee44b68984/cf 2023-07-18 23:11:30,987 INFO [StoreOpener-17d1b54928d3d3ab5c91f9642d379a3f-1] regionserver.HStore(310): Store=17d1b54928d3d3ab5c91f9642d379a3f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 23:11:30,988 INFO [StoreOpener-7581d9896be97316f7e287ee44b68984-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7581d9896be97316f7e287ee44b68984 columnFamilyName cf 2023-07-18 23:11:30,989 INFO [StoreOpener-7581d9896be97316f7e287ee44b68984-1] regionserver.HStore(310): Store=7581d9896be97316f7e287ee44b68984/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 23:11:30,990 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7581d9896be97316f7e287ee44b68984 2023-07-18 23:11:30,990 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/17d1b54928d3d3ab5c91f9642d379a3f 2023-07-18 23:11:30,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7581d9896be97316f7e287ee44b68984 2023-07-18 23:11:30,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/17d1b54928d3d3ab5c91f9642d379a3f 2023-07-18 23:11:31,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7581d9896be97316f7e287ee44b68984 2023-07-18 23:11:31,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 17d1b54928d3d3ab5c91f9642d379a3f 2023-07-18 23:11:31,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7581d9896be97316f7e287ee44b68984/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 23:11:31,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/17d1b54928d3d3ab5c91f9642d379a3f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 23:11:31,008 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7581d9896be97316f7e287ee44b68984; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69794390, jitterRate=0.04001745581626892}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 23:11:31,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7581d9896be97316f7e287ee44b68984: 2023-07-18 23:11:31,008 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 17d1b54928d3d3ab5c91f9642d379a3f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66756235, jitterRate=-0.005254581570625305}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 23:11:31,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 17d1b54928d3d3ab5c91f9642d379a3f: 2023-07-18 23:11:31,009 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689721890499.7581d9896be97316f7e287ee44b68984., pid=70, masterSystemTime=1689721890970 2023-07-18 23:11:31,009 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689721890499.17d1b54928d3d3ab5c91f9642d379a3f., pid=69, masterSystemTime=1689721890970 2023-07-18 23:11:31,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689721890499.7581d9896be97316f7e287ee44b68984. 2023-07-18 23:11:31,011 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689721890499.7581d9896be97316f7e287ee44b68984. 2023-07-18 23:11:31,011 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=7581d9896be97316f7e287ee44b68984, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:31,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689721890499.17d1b54928d3d3ab5c91f9642d379a3f. 2023-07-18 23:11:31,011 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689721890499.17d1b54928d3d3ab5c91f9642d379a3f. 2023-07-18 23:11:31,011 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689721890499.7581d9896be97316f7e287ee44b68984.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689721891011"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689721891011"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689721891011"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689721891011"}]},"ts":"1689721891011"} 2023-07-18 23:11:31,012 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=17d1b54928d3d3ab5c91f9642d379a3f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:31,012 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689721890499.17d1b54928d3d3ab5c91f9642d379a3f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689721891011"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689721891011"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689721891011"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689721891011"}]},"ts":"1689721891011"} 2023-07-18 23:11:31,015 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=67 2023-07-18 23:11:31,015 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure 7581d9896be97316f7e287ee44b68984, server=jenkins-hbase4.apache.org,45387,1689721809516 in 198 msec 2023-07-18 23:11:31,016 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=68 2023-07-18 23:11:31,016 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 17d1b54928d3d3ab5c91f9642d379a3f, server=jenkins-hbase4.apache.org,45431,1689721809599 in 200 msec 2023-07-18 23:11:31,017 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7581d9896be97316f7e287ee44b68984, ASSIGN in 367 msec 2023-07-18 23:11:31,019 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=66 2023-07-18 23:11:31,019 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=17d1b54928d3d3ab5c91f9642d379a3f, ASSIGN in 367 msec 2023-07-18 23:11:31,019 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 23:11:31,020 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689721891019"}]},"ts":"1689721891019"} 2023-07-18 23:11:31,021 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-18 23:11:31,024 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 23:11:31,025 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-18 23:11:31,026 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45387] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-18 23:11:31,028 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 23:11:31,028 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 23:11:31,028 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 23:11:31,028 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 23:11:31,030 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 23:11:31,030 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-18 23:11:31,030 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 23:11:31,030 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 23:11:31,030 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-18 23:11:31,030 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 23:11:31,030 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-18 23:11:31,030 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-18 23:11:31,032 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 530 msec 2023-07-18 23:11:31,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-18 23:11:31,117 INFO [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-18 23:11:31,157 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 7581d9896be97316f7e287ee44b68984, 17d1b54928d3d3ab5c91f9642d379a3f 2023-07-18 23:11:31,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[7581d9896be97316f7e287ee44b68984, 17d1b54928d3d3ab5c91f9642d379a3f], force=true 2023-07-18 23:11:31,186 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[7581d9896be97316f7e287ee44b68984, 17d1b54928d3d3ab5c91f9642d379a3f], force=true 2023-07-18 23:11:31,186 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[7581d9896be97316f7e287ee44b68984, 17d1b54928d3d3ab5c91f9642d379a3f], force=true 2023-07-18 23:11:31,186 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[7581d9896be97316f7e287ee44b68984, 17d1b54928d3d3ab5c91f9642d379a3f], force=true 2023-07-18 23:11:31,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-18 23:11:31,224 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7581d9896be97316f7e287ee44b68984, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=17d1b54928d3d3ab5c91f9642d379a3f, UNASSIGN}] 2023-07-18 23:11:31,227 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7581d9896be97316f7e287ee44b68984, UNASSIGN 2023-07-18 23:11:31,227 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=17d1b54928d3d3ab5c91f9642d379a3f, UNASSIGN 2023-07-18 23:11:31,238 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=7581d9896be97316f7e287ee44b68984, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:31,238 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=17d1b54928d3d3ab5c91f9642d379a3f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:31,239 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689721890499.7581d9896be97316f7e287ee44b68984.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689721891238"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689721891238"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689721891238"}]},"ts":"1689721891238"} 2023-07-18 23:11:31,239 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689721890499.17d1b54928d3d3ab5c91f9642d379a3f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689721891238"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689721891238"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689721891238"}]},"ts":"1689721891238"} 2023-07-18 23:11:31,241 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 7581d9896be97316f7e287ee44b68984, server=jenkins-hbase4.apache.org,45387,1689721809516}] 2023-07-18 23:11:31,242 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 17d1b54928d3d3ab5c91f9642d379a3f, server=jenkins-hbase4.apache.org,45431,1689721809599}] 2023-07-18 23:11:31,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-18 23:11:31,394 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7581d9896be97316f7e287ee44b68984 2023-07-18 23:11:31,396 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7581d9896be97316f7e287ee44b68984, disabling compactions & flushes 2023-07-18 23:11:31,396 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689721890499.7581d9896be97316f7e287ee44b68984. 2023-07-18 23:11:31,396 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689721890499.7581d9896be97316f7e287ee44b68984. 2023-07-18 23:11:31,396 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689721890499.7581d9896be97316f7e287ee44b68984. after waiting 0 ms 2023-07-18 23:11:31,396 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689721890499.7581d9896be97316f7e287ee44b68984. 2023-07-18 23:11:31,396 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 7581d9896be97316f7e287ee44b68984 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-18 23:11:31,397 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 17d1b54928d3d3ab5c91f9642d379a3f 2023-07-18 23:11:31,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 17d1b54928d3d3ab5c91f9642d379a3f, disabling compactions & flushes 2023-07-18 23:11:31,398 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689721890499.17d1b54928d3d3ab5c91f9642d379a3f. 2023-07-18 23:11:31,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689721890499.17d1b54928d3d3ab5c91f9642d379a3f. 2023-07-18 23:11:31,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689721890499.17d1b54928d3d3ab5c91f9642d379a3f. after waiting 0 ms 2023-07-18 23:11:31,399 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689721890499.17d1b54928d3d3ab5c91f9642d379a3f. 2023-07-18 23:11:31,399 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 17d1b54928d3d3ab5c91f9642d379a3f 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-18 23:11:31,423 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7581d9896be97316f7e287ee44b68984/.tmp/cf/8bef5a5af0fe4fd6bae4fbe5fb02635d 2023-07-18 23:11:31,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7581d9896be97316f7e287ee44b68984/.tmp/cf/8bef5a5af0fe4fd6bae4fbe5fb02635d as hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7581d9896be97316f7e287ee44b68984/cf/8bef5a5af0fe4fd6bae4fbe5fb02635d 2023-07-18 23:11:31,434 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/17d1b54928d3d3ab5c91f9642d379a3f/.tmp/cf/664939902aed4def82103ed4ae455697 2023-07-18 23:11:31,441 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7581d9896be97316f7e287ee44b68984/cf/8bef5a5af0fe4fd6bae4fbe5fb02635d, entries=1, sequenceid=5, filesize=4.7 K 2023-07-18 23:11:31,441 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/17d1b54928d3d3ab5c91f9642d379a3f/.tmp/cf/664939902aed4def82103ed4ae455697 as hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/17d1b54928d3d3ab5c91f9642d379a3f/cf/664939902aed4def82103ed4ae455697 2023-07-18 23:11:31,442 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 7581d9896be97316f7e287ee44b68984 in 46ms, sequenceid=5, compaction requested=false 2023-07-18 23:11:31,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-18 23:11:31,452 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7581d9896be97316f7e287ee44b68984/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-18 23:11:31,452 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 23:11:31,452 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689721890499.7581d9896be97316f7e287ee44b68984. 2023-07-18 23:11:31,452 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7581d9896be97316f7e287ee44b68984: 2023-07-18 23:11:31,453 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/17d1b54928d3d3ab5c91f9642d379a3f/cf/664939902aed4def82103ed4ae455697, entries=1, sequenceid=5, filesize=4.7 K 2023-07-18 23:11:31,454 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7581d9896be97316f7e287ee44b68984 2023-07-18 23:11:31,455 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=7581d9896be97316f7e287ee44b68984, regionState=CLOSED 2023-07-18 23:11:31,455 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689721890499.7581d9896be97316f7e287ee44b68984.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689721891455"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689721891455"}]},"ts":"1689721891455"} 2023-07-18 23:11:31,457 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 17d1b54928d3d3ab5c91f9642d379a3f in 58ms, sequenceid=5, compaction requested=false 2023-07-18 23:11:31,462 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-18 23:11:31,462 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 7581d9896be97316f7e287ee44b68984, server=jenkins-hbase4.apache.org,45387,1689721809516 in 215 msec 2023-07-18 23:11:31,467 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7581d9896be97316f7e287ee44b68984, UNASSIGN in 241 msec 2023-07-18 23:11:31,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/17d1b54928d3d3ab5c91f9642d379a3f/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-18 23:11:31,472 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 23:11:31,472 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689721890499.17d1b54928d3d3ab5c91f9642d379a3f. 2023-07-18 23:11:31,472 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 17d1b54928d3d3ab5c91f9642d379a3f: 2023-07-18 23:11:31,473 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 17d1b54928d3d3ab5c91f9642d379a3f 2023-07-18 23:11:31,474 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=17d1b54928d3d3ab5c91f9642d379a3f, regionState=CLOSED 2023-07-18 23:11:31,474 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689721890499.17d1b54928d3d3ab5c91f9642d379a3f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689721891474"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689721891474"}]},"ts":"1689721891474"} 2023-07-18 23:11:31,477 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-18 23:11:31,477 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 17d1b54928d3d3ab5c91f9642d379a3f, server=jenkins-hbase4.apache.org,45431,1689721809599 in 234 msec 2023-07-18 23:11:31,479 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=71 2023-07-18 23:11:31,479 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=17d1b54928d3d3ab5c91f9642d379a3f, UNASSIGN in 253 msec 2023-07-18 23:11:31,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-18 23:11:31,651 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/285ad95271b52ab7ca90ad3605ddb526/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-18 23:11:31,658 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689721890499.7581d9896be97316f7e287ee44b68984.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-18 23:11:31,658 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689721890499.17d1b54928d3d3ab5c91f9642d379a3f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-18 23:11:31,658 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689721890500.285ad95271b52ab7ca90ad3605ddb526.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-18 23:11:31,751 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=285ad95271b52ab7ca90ad3605ddb526, ASSIGN}] 2023-07-18 23:11:31,752 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=285ad95271b52ab7ca90ad3605ddb526, ASSIGN 2023-07-18 23:11:31,753 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=285ad95271b52ab7ca90ad3605ddb526, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,45387,1689721809516; forceNewPlan=false, retain=false 2023-07-18 23:11:31,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-18 23:11:31,903 INFO [jenkins-hbase4:46651] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-18 23:11:31,906 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=285ad95271b52ab7ca90ad3605ddb526, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:31,906 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689721890500.285ad95271b52ab7ca90ad3605ddb526.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689721891906"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689721891906"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689721891906"}]},"ts":"1689721891906"} 2023-07-18 23:11:31,916 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 285ad95271b52ab7ca90ad3605ddb526, server=jenkins-hbase4.apache.org,45387,1689721809516}] 2023-07-18 23:11:32,071 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689721890500.285ad95271b52ab7ca90ad3605ddb526. 2023-07-18 23:11:32,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 285ad95271b52ab7ca90ad3605ddb526, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689721890500.285ad95271b52ab7ca90ad3605ddb526.', STARTKEY => '', ENDKEY => ''} 2023-07-18 23:11:32,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689721890500.285ad95271b52ab7ca90ad3605ddb526. service=AccessControlService 2023-07-18 23:11:32,072 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 23:11:32,072 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 285ad95271b52ab7ca90ad3605ddb526 2023-07-18 23:11:32,072 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689721890500.285ad95271b52ab7ca90ad3605ddb526.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 23:11:32,072 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 285ad95271b52ab7ca90ad3605ddb526 2023-07-18 23:11:32,072 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 285ad95271b52ab7ca90ad3605ddb526 2023-07-18 23:11:32,073 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/285ad95271b52ab7ca90ad3605ddb526/.regioninfo 2023-07-18 23:11:32,103 INFO [StoreOpener-285ad95271b52ab7ca90ad3605ddb526-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 285ad95271b52ab7ca90ad3605ddb526 2023-07-18 23:11:32,105 DEBUG [StoreOpener-285ad95271b52ab7ca90ad3605ddb526-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/285ad95271b52ab7ca90ad3605ddb526/cf 2023-07-18 23:11:32,105 DEBUG [StoreOpener-285ad95271b52ab7ca90ad3605ddb526-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/285ad95271b52ab7ca90ad3605ddb526/cf 2023-07-18 23:11:32,106 INFO [StoreOpener-285ad95271b52ab7ca90ad3605ddb526-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 285ad95271b52ab7ca90ad3605ddb526 columnFamilyName cf 2023-07-18 23:11:32,157 DEBUG [StoreOpener-285ad95271b52ab7ca90ad3605ddb526-1] regionserver.HStore(539): loaded hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/285ad95271b52ab7ca90ad3605ddb526/cf/664939902aed4def82103ed4ae455697.17d1b54928d3d3ab5c91f9642d379a3f->hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/17d1b54928d3d3ab5c91f9642d379a3f/cf/664939902aed4def82103ed4ae455697-top 2023-07-18 23:11:32,165 DEBUG [StoreOpener-285ad95271b52ab7ca90ad3605ddb526-1] regionserver.HStore(539): loaded hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/285ad95271b52ab7ca90ad3605ddb526/cf/8bef5a5af0fe4fd6bae4fbe5fb02635d.7581d9896be97316f7e287ee44b68984->hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7581d9896be97316f7e287ee44b68984/cf/8bef5a5af0fe4fd6bae4fbe5fb02635d-top 2023-07-18 23:11:32,165 INFO [StoreOpener-285ad95271b52ab7ca90ad3605ddb526-1] regionserver.HStore(310): Store=285ad95271b52ab7ca90ad3605ddb526/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 23:11:32,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/285ad95271b52ab7ca90ad3605ddb526 2023-07-18 23:11:32,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/285ad95271b52ab7ca90ad3605ddb526 2023-07-18 23:11:32,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 285ad95271b52ab7ca90ad3605ddb526 2023-07-18 23:11:32,175 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 285ad95271b52ab7ca90ad3605ddb526; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70406272, jitterRate=0.04913520812988281}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 23:11:32,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 285ad95271b52ab7ca90ad3605ddb526: 2023-07-18 23:11:32,177 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689721890500.285ad95271b52ab7ca90ad3605ddb526., pid=77, masterSystemTime=1689721892067 2023-07-18 23:11:32,178 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689721890500.285ad95271b52ab7ca90ad3605ddb526.,because compaction is disabled. 2023-07-18 23:11:32,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689721890500.285ad95271b52ab7ca90ad3605ddb526. 2023-07-18 23:11:32,182 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=285ad95271b52ab7ca90ad3605ddb526, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:32,182 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689721890500.285ad95271b52ab7ca90ad3605ddb526. 2023-07-18 23:11:32,182 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689721890500.285ad95271b52ab7ca90ad3605ddb526.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689721892182"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689721892182"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689721892182"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689721892182"}]},"ts":"1689721892182"} 2023-07-18 23:11:32,186 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-18 23:11:32,186 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 285ad95271b52ab7ca90ad3605ddb526, server=jenkins-hbase4.apache.org,45387,1689721809516 in 268 msec 2023-07-18 23:11:32,193 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-18 23:11:32,194 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=285ad95271b52ab7ca90ad3605ddb526, ASSIGN in 435 msec 2023-07-18 23:11:32,202 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[7581d9896be97316f7e287ee44b68984, 17d1b54928d3d3ab5c91f9642d379a3f], force=true in 1.0320 sec 2023-07-18 23:11:32,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-18 23:11:32,296 INFO [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-18 23:11:32,297 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-18 23:11:32,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689721892297 (current time:1689721892297). 2023-07-18 23:11:32,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 23:11:32,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(139): Connect 0x68e39c8c to 127.0.0.1:61306 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 23:11:32,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7324919e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 23:11:32,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 23:11:32,312 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56402, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 23:11:32,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x68e39c8c to 127.0.0.1:61306 2023-07-18 23:11:32,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 23:11:32,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(139): Connect 0x388212b3 to 127.0.0.1:61306 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 23:11:32,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4cf1fed3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 23:11:32,361 DEBUG [hconnection-0x1b8e2eb2-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 23:11:32,370 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56406, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 23:11:32,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x388212b3 to 127.0.0.1:61306 2023-07-18 23:11:32,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 23:11:32,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-18 23:11:32,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 23:11:32,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-18 23:11:32,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-18 23:11:32,390 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-18 23:11:32,390 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689722492390 2023-07-18 23:11:32,391 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-18 23:11:32,397 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 23:11:32,398 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 23:11:32,398 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-18 23:11:32,398 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-18 23:11:32,402 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 10 msec 2023-07-18 23:11:32,404 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-18 23:11:32,404 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689722492404 2023-07-18 23:11:32,426 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,427 INFO [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-18 23:11:32,427 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 23:11:32,428 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-18 23:11:32,428 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-18 23:11:32,429 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,429 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,431 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:11:32,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:11:32,432 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:32,432 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:11:32,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:11:32,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:11:32,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:11:32,432 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:32,432 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 23:11:32,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,433 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,434 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-18 23:11:32,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-18 23:11:32,434 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-18 23:11:32,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,434 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-18 23:11:32,434 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,434 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-18 23:11:32,435 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 23:11:32,434 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,435 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-18 23:11:32,435 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 23:11:32,438 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-18 23:11:32,438 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-18 23:11:32,438 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-18 23:11:32,438 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:11:32,438 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-18 23:11:32,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:11:32,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:11:32,439 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45431,1689721809599' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-18 23:11:32,438 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45387,1689721809516' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-18 23:11:32,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,439 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,441 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-18 23:11:32,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,441 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-18 23:11:32,441 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,441 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-18 23:11:32,442 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 23:11:32,442 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:32,443 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:32,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:11:32,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:11:32,443 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-18 23:11:32,443 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-18 23:11:32,443 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38625,1689721809654' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-18 23:11:32,443 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,443 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 23:11:32,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:11:32,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:11:32,444 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,444 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 23:11:32,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,448 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:32,448 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:32,448 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 23:11:32,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:32,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:11:32,449 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45387,1689721809516' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-18 23:11:32,450 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47d2b094[Count = 0] remaining members to acquire global barrier 2023-07-18 23:11:32,450 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-18 23:11:32,450 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,451 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,452 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,452 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,452 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-18 23:11:32,452 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-18 23:11:32,452 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,45431,1689721809599' in zk 2023-07-18 23:11:32,452 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:32,452 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 23:11:32,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,452 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-18 23:11:32,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,452 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-18 23:11:32,452 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-18 23:11:32,452 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,38625,1689721809654' in zk 2023-07-18 23:11:32,454 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-18 23:11:32,454 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 23:11:32,454 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-18 23:11:32,454 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-18 23:11:32,454 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 23:11:32,454 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-18 23:11:32,458 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 23:11:32,458 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 23:11:32,458 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689721890500.285ad95271b52ab7ca90ad3605ddb526. 2023-07-18 23:11:32,458 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689721890500.285ad95271b52ab7ca90ad3605ddb526. started... 2023-07-18 23:11:32,460 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 285ad95271b52ab7ca90ad3605ddb526: 2023-07-18 23:11:32,460 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689721890500.285ad95271b52ab7ca90ad3605ddb526.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,460 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 23:11:32,460 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/285ad95271b52ab7ca90ad3605ddb526/cf/664939902aed4def82103ed4ae455697.17d1b54928d3d3ab5c91f9642d379a3f->hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/17d1b54928d3d3ab5c91f9642d379a3f/cf/664939902aed4def82103ed4ae455697-top, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/285ad95271b52ab7ca90ad3605ddb526/cf/8bef5a5af0fe4fd6bae4fbe5fb02635d.7581d9896be97316f7e287ee44b68984->hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7581d9896be97316f7e287ee44b68984/cf/8bef5a5af0fe4fd6bae4fbe5fb02635d-top] hfiles 2023-07-18 23:11:32,460 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/285ad95271b52ab7ca90ad3605ddb526/cf/664939902aed4def82103ed4ae455697.17d1b54928d3d3ab5c91f9642d379a3f for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,461 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/285ad95271b52ab7ca90ad3605ddb526/cf/8bef5a5af0fe4fd6bae4fbe5fb02635d.7581d9896be97316f7e287ee44b68984 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,463 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689721818645_0004_000001 (auth:SIMPLE) 2023-07-18 23:11:32,478 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689721890500.285ad95271b52ab7ca90ad3605ddb526. completed. 2023-07-18 23:11:32,478 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689721890500.285ad95271b52ab7ca90ad3605ddb526. 2023-07-18 23:11:32,478 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 23:11:32,478 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 23:11:32,478 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:32,478 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-18 23:11:32,478 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,45387,1689721809516' in zk 2023-07-18 23:11:32,483 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:32,483 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-18 23:11:32,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:32,483 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 23:11:32,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:11:32,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:11:32,484 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-18 23:11:32,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:11:32,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:11:32,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:32,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:32,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:32,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:11:32,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:32,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:32,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:32,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,45387,1689721809516': 2023-07-18 23:11:32,489 INFO [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-18 23:11:32,489 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 23:11:32,489 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 23:11:32,489 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45387,1689721809516' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-18 23:11:32,489 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,489 INFO [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 23:11:32,491 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,491 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:11:32,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:11:32,491 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:11:32,491 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,492 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,492 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:11:32,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:11:32,493 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:32,492 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:11:32,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:11:32,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:11:32,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:11:32,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,493 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:32,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:11:32,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:11:32,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:11:32,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:11:32,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,494 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:32,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:32,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:32,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:32,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:11:32,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,498 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 23:11:32,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-18 23:11:32,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-18 23:11:32,500 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 23:11:32,501 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:32,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:32,502 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:32,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:32,504 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:32,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:32,508 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:11:32,508 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:11:32,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:11:32,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:11:32,509 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:11:32,509 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:11:32,509 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:11:32,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:11:32,509 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:32,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:11:32,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:11:32,509 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 23:11:32,509 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:11:32,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:11:32,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:11:32,509 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,509 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:11:32,510 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:32,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:11:32,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:11:32,510 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,510 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:32,510 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,510 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:32,510 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,510 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:32,510 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:32,510 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,510 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:11:32,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:11:32,511 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,580 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:32,700 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 23:11:32,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-18 23:11:32,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-18 23:11:32,702 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-18 23:11:33,002 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 23:11:33,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-18 23:11:33,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-18 23:11:33,003 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-18 23:11:33,053 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-18 23:11:33,053 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:33,054 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:33,054 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689721892391Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689721892510 (+119 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689721892510Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689721892530 (+20 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689721892554 (+24 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689721893053 (+499 ms) 2023-07-18 23:11:33,056 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-18 23:11:33,057 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 660 msec 2023-07-18 23:11:33,475 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 23:11:33,503 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 23:11:33,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-18 23:11:33,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 23:11:33,505 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/export-test/export-1689721893505 2023-07-18 23:11:33,505 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45655, tgtDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/export-test/export-1689721893505, rawTgtDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/export-test/export-1689721893505, srcFsUri=hdfs://localhost:45655, srcDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054 2023-07-18 23:11:33,539 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45655, inputRoot=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054 2023-07-18 23:11:33,539 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1098711267_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/export-test/export-1689721893505, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/export-test/export-1689721893505/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:33,539 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45655, inputRoot=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054, snapshotDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-18 23:11:33,559 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/export-test/export-1689721893505/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:33,643 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-18 23:11:33,644 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-18 23:11:33,645 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-18 23:11:33,645 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-18 23:11:34,691 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/hadoop-1713023605930930205.jar 2023-07-18 23:11:34,691 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-18 23:11:34,692 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-18 23:11:34,774 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/hadoop-7619295185097318821.jar 2023-07-18 23:11:34,775 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-18 23:11:34,776 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-18 23:11:34,776 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-18 23:11:34,776 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-18 23:11:34,777 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-18 23:11:34,777 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-18 23:11:34,778 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-18 23:11:34,778 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-18 23:11:34,779 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-18 23:11:34,779 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-18 23:11:34,779 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-18 23:11:34,780 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-18 23:11:34,781 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-18 23:11:34,781 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-18 23:11:34,782 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-18 23:11:34,783 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-18 23:11:34,783 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 23:11:34,784 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 23:11:34,785 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 23:11:34,785 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 23:11:34,785 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 23:11:34,786 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 23:11:34,787 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 23:11:36,825 WARN [Listener at jenkins-hbase4.apache.org/33217] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-18 23:11:36,834 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-18 23:11:36,838 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-18 23:11:37,368 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 23:11:37,369 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 23:11:37,482 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689721818645_0005_000001 (auth:SIMPLE) 2023-07-18 23:11:43,673 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689721818645_0005_000001 (auth:SIMPLE) 2023-07-18 23:11:45,958 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689721818645_0005_000001 (auth:SIMPLE) 2023-07-18 23:11:52,542 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-18 23:11:52,553 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-18 23:11:52,565 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:52,565 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-18 23:11:52,566 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-18 23:11:52,566 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-702194233_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:52,567 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(367): hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-18 23:11:52,567 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(367): hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-18 23:11:52,567 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-702194233_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/export-test/export-1689721893505/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/export-test/export-1689721893505/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:52,567 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(367): hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/export-test/export-1689721893505/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-18 23:11:52,568 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(367): hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/export-test/export-1689721893505/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-18 23:11:52,580 INFO [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:52,581 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:52,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:52,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-18 23:11:52,586 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689721912586"}]},"ts":"1689721912586"} 2023-07-18 23:11:52,588 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-18 23:11:52,590 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-18 23:11:52,597 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=285ad95271b52ab7ca90ad3605ddb526, UNASSIGN}] 2023-07-18 23:11:52,600 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=285ad95271b52ab7ca90ad3605ddb526, UNASSIGN 2023-07-18 23:11:52,601 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=285ad95271b52ab7ca90ad3605ddb526, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:52,601 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689721890500.285ad95271b52ab7ca90ad3605ddb526.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689721912601"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689721912601"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689721912601"}]},"ts":"1689721912601"} 2023-07-18 23:11:52,603 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 285ad95271b52ab7ca90ad3605ddb526, server=jenkins-hbase4.apache.org,45387,1689721809516}] 2023-07-18 23:11:52,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-18 23:11:52,756 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 285ad95271b52ab7ca90ad3605ddb526 2023-07-18 23:11:52,756 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 285ad95271b52ab7ca90ad3605ddb526, disabling compactions & flushes 2023-07-18 23:11:52,756 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689721890500.285ad95271b52ab7ca90ad3605ddb526. 2023-07-18 23:11:52,756 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689721890500.285ad95271b52ab7ca90ad3605ddb526. 2023-07-18 23:11:52,756 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689721890500.285ad95271b52ab7ca90ad3605ddb526. after waiting 0 ms 2023-07-18 23:11:52,756 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689721890500.285ad95271b52ab7ca90ad3605ddb526. 2023-07-18 23:11:52,781 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/285ad95271b52ab7ca90ad3605ddb526/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-18 23:11:52,782 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 23:11:52,784 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689721890500.285ad95271b52ab7ca90ad3605ddb526. 2023-07-18 23:11:52,784 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 285ad95271b52ab7ca90ad3605ddb526: 2023-07-18 23:11:52,786 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 285ad95271b52ab7ca90ad3605ddb526 2023-07-18 23:11:52,787 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=285ad95271b52ab7ca90ad3605ddb526, regionState=CLOSED 2023-07-18 23:11:52,787 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689721890500.285ad95271b52ab7ca90ad3605ddb526.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689721912787"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689721912787"}]},"ts":"1689721912787"} 2023-07-18 23:11:52,797 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-18 23:11:52,797 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 285ad95271b52ab7ca90ad3605ddb526, server=jenkins-hbase4.apache.org,45387,1689721809516 in 186 msec 2023-07-18 23:11:52,804 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-18 23:11:52,804 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=285ad95271b52ab7ca90ad3605ddb526, UNASSIGN in 200 msec 2023-07-18 23:11:52,815 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689721912815"}]},"ts":"1689721912815"} 2023-07-18 23:11:52,817 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-18 23:11:52,819 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-18 23:11:52,827 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 244 msec 2023-07-18 23:11:52,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-18 23:11:52,889 INFO [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-18 23:11:52,890 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:52,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:52,894 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:52,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:52,895 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:52,934 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45387] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:52,948 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:52,948 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:52,949 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-18 23:11:52,949 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:52,949 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:52,951 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 23:11:52,951 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 23:11:52,951 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-18 23:11:52,951 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-18 23:11:52,951 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-18 23:11:52,951 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:52,952 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 23:11:52,952 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-18 23:11:52,951 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 23:11:52,953 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-18 23:11:52,953 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-18 23:11:52,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-18 23:11:52,954 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 23:11:52,955 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 23:11:52,955 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 23:11:52,955 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 23:11:52,956 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/285ad95271b52ab7ca90ad3605ddb526 2023-07-18 23:11:52,957 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/17d1b54928d3d3ab5c91f9642d379a3f 2023-07-18 23:11:52,957 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7581d9896be97316f7e287ee44b68984 2023-07-18 23:11:52,960 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/17d1b54928d3d3ab5c91f9642d379a3f/cf, FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/17d1b54928d3d3ab5c91f9642d379a3f/recovered.edits] 2023-07-18 23:11:52,964 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/285ad95271b52ab7ca90ad3605ddb526/cf, FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/285ad95271b52ab7ca90ad3605ddb526/recovered.edits] 2023-07-18 23:11:52,965 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7581d9896be97316f7e287ee44b68984/cf, FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7581d9896be97316f7e287ee44b68984/recovered.edits] 2023-07-18 23:11:52,975 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/17d1b54928d3d3ab5c91f9642d379a3f/cf/664939902aed4def82103ed4ae455697 to hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/17d1b54928d3d3ab5c91f9642d379a3f/cf/664939902aed4def82103ed4ae455697 2023-07-18 23:11:52,978 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7581d9896be97316f7e287ee44b68984/cf/8bef5a5af0fe4fd6bae4fbe5fb02635d to hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7581d9896be97316f7e287ee44b68984/cf/8bef5a5af0fe4fd6bae4fbe5fb02635d 2023-07-18 23:11:52,982 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/285ad95271b52ab7ca90ad3605ddb526/cf/664939902aed4def82103ed4ae455697.17d1b54928d3d3ab5c91f9642d379a3f to hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/285ad95271b52ab7ca90ad3605ddb526/cf/664939902aed4def82103ed4ae455697.17d1b54928d3d3ab5c91f9642d379a3f 2023-07-18 23:11:52,982 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/17d1b54928d3d3ab5c91f9642d379a3f/recovered.edits/8.seqid to hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/17d1b54928d3d3ab5c91f9642d379a3f/recovered.edits/8.seqid 2023-07-18 23:11:52,988 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/17d1b54928d3d3ab5c91f9642d379a3f 2023-07-18 23:11:52,993 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/285ad95271b52ab7ca90ad3605ddb526/cf/8bef5a5af0fe4fd6bae4fbe5fb02635d.7581d9896be97316f7e287ee44b68984 to hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/285ad95271b52ab7ca90ad3605ddb526/cf/8bef5a5af0fe4fd6bae4fbe5fb02635d.7581d9896be97316f7e287ee44b68984 2023-07-18 23:11:52,996 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7581d9896be97316f7e287ee44b68984/recovered.edits/8.seqid to hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7581d9896be97316f7e287ee44b68984/recovered.edits/8.seqid 2023-07-18 23:11:52,997 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7581d9896be97316f7e287ee44b68984 2023-07-18 23:11:52,999 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/285ad95271b52ab7ca90ad3605ddb526/recovered.edits/12.seqid to hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/285ad95271b52ab7ca90ad3605ddb526/recovered.edits/12.seqid 2023-07-18 23:11:53,001 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/285ad95271b52ab7ca90ad3605ddb526 2023-07-18 23:11:53,001 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-18 23:11:53,005 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:53,021 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-18 23:11:53,027 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-18 23:11:53,036 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:53,036 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-18 23:11:53,036 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689721890500.285ad95271b52ab7ca90ad3605ddb526.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689721913036"}]},"ts":"9223372036854775807"} 2023-07-18 23:11:53,039 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-18 23:11:53,039 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 285ad95271b52ab7ca90ad3605ddb526, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689721890500.285ad95271b52ab7ca90ad3605ddb526.', STARTKEY => '', ENDKEY => ''}] 2023-07-18 23:11:53,039 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-18 23:11:53,039 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689721913039"}]},"ts":"9223372036854775807"} 2023-07-18 23:11:53,042 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-18 23:11:53,047 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:53,053 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 157 msec 2023-07-18 23:11:53,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-18 23:11:53,056 INFO [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-18 23:11:53,056 INFO [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:53,057 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:53,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:53,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-18 23:11:53,069 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689721913069"}]},"ts":"1689721913069"} 2023-07-18 23:11:53,071 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-18 23:11:53,073 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-18 23:11:53,074 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=dd5a0ddce4f156e9f2bfe2ca38db9479, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=12791e0779a2553cc33b5959e56831d4, UNASSIGN}] 2023-07-18 23:11:53,075 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=12791e0779a2553cc33b5959e56831d4, UNASSIGN 2023-07-18 23:11:53,076 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=dd5a0ddce4f156e9f2bfe2ca38db9479, UNASSIGN 2023-07-18 23:11:53,077 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=12791e0779a2553cc33b5959e56831d4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:53,078 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=dd5a0ddce4f156e9f2bfe2ca38db9479, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:53,078 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689721888421.12791e0779a2553cc33b5959e56831d4.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689721913077"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689721913077"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689721913077"}]},"ts":"1689721913077"} 2023-07-18 23:11:53,078 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689721888421.dd5a0ddce4f156e9f2bfe2ca38db9479.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689721913078"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689721913078"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689721913078"}]},"ts":"1689721913078"} 2023-07-18 23:11:53,082 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure 12791e0779a2553cc33b5959e56831d4, server=jenkins-hbase4.apache.org,38625,1689721809654}] 2023-07-18 23:11:53,097 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure dd5a0ddce4f156e9f2bfe2ca38db9479, server=jenkins-hbase4.apache.org,45431,1689721809599}] 2023-07-18 23:11:53,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-18 23:11:53,250 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 12791e0779a2553cc33b5959e56831d4 2023-07-18 23:11:53,250 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close dd5a0ddce4f156e9f2bfe2ca38db9479 2023-07-18 23:11:53,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 12791e0779a2553cc33b5959e56831d4, disabling compactions & flushes 2023-07-18 23:11:53,250 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689721888421.12791e0779a2553cc33b5959e56831d4. 2023-07-18 23:11:53,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing dd5a0ddce4f156e9f2bfe2ca38db9479, disabling compactions & flushes 2023-07-18 23:11:53,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689721888421.12791e0779a2553cc33b5959e56831d4. 2023-07-18 23:11:53,251 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689721888421.dd5a0ddce4f156e9f2bfe2ca38db9479. 2023-07-18 23:11:53,251 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689721888421.12791e0779a2553cc33b5959e56831d4. after waiting 0 ms 2023-07-18 23:11:53,251 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689721888421.12791e0779a2553cc33b5959e56831d4. 2023-07-18 23:11:53,251 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689721888421.dd5a0ddce4f156e9f2bfe2ca38db9479. 2023-07-18 23:11:53,251 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689721888421.dd5a0ddce4f156e9f2bfe2ca38db9479. after waiting 0 ms 2023-07-18 23:11:53,251 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689721888421.dd5a0ddce4f156e9f2bfe2ca38db9479. 2023-07-18 23:11:53,270 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion/dd5a0ddce4f156e9f2bfe2ca38db9479/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 23:11:53,270 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithMergeRegion/12791e0779a2553cc33b5959e56831d4/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 23:11:53,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 23:11:53,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 23:11:53,272 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689721888421.12791e0779a2553cc33b5959e56831d4. 2023-07-18 23:11:53,273 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689721888421.dd5a0ddce4f156e9f2bfe2ca38db9479. 2023-07-18 23:11:53,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 12791e0779a2553cc33b5959e56831d4: 2023-07-18 23:11:53,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for dd5a0ddce4f156e9f2bfe2ca38db9479: 2023-07-18 23:11:53,276 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 12791e0779a2553cc33b5959e56831d4 2023-07-18 23:11:53,276 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=12791e0779a2553cc33b5959e56831d4, regionState=CLOSED 2023-07-18 23:11:53,276 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689721888421.12791e0779a2553cc33b5959e56831d4.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689721913276"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689721913276"}]},"ts":"1689721913276"} 2023-07-18 23:11:53,276 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed dd5a0ddce4f156e9f2bfe2ca38db9479 2023-07-18 23:11:53,278 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=dd5a0ddce4f156e9f2bfe2ca38db9479, regionState=CLOSED 2023-07-18 23:11:53,278 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689721888421.dd5a0ddce4f156e9f2bfe2ca38db9479.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689721913278"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689721913278"}]},"ts":"1689721913278"} 2023-07-18 23:11:53,283 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=86 2023-07-18 23:11:53,283 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure 12791e0779a2553cc33b5959e56831d4, server=jenkins-hbase4.apache.org,38625,1689721809654 in 198 msec 2023-07-18 23:11:53,286 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=85 2023-07-18 23:11:53,286 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure dd5a0ddce4f156e9f2bfe2ca38db9479, server=jenkins-hbase4.apache.org,45431,1689721809599 in 183 msec 2023-07-18 23:11:53,287 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=12791e0779a2553cc33b5959e56831d4, UNASSIGN in 210 msec 2023-07-18 23:11:53,290 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-18 23:11:53,290 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=dd5a0ddce4f156e9f2bfe2ca38db9479, UNASSIGN in 213 msec 2023-07-18 23:11:53,293 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689721913293"}]},"ts":"1689721913293"} 2023-07-18 23:11:53,294 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-18 23:11:53,296 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-18 23:11:53,297 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 239 msec 2023-07-18 23:11:53,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-18 23:11:53,372 INFO [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-18 23:11:53,373 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:53,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:53,376 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:53,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:53,377 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:53,379 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45387] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:53,381 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:53,381 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:53,381 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:53,381 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:53,382 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-18 23:11:53,382 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-18 23:11:53,382 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-18 23:11:53,382 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/dd5a0ddce4f156e9f2bfe2ca38db9479 2023-07-18 23:11:53,382 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/12791e0779a2553cc33b5959e56831d4 2023-07-18 23:11:53,382 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-18 23:11:53,384 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:53,384 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 23:11:53,384 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:53,384 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:53,384 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:53,384 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 23:11:53,384 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 23:11:53,384 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 23:11:53,384 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/dd5a0ddce4f156e9f2bfe2ca38db9479/cf, FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/dd5a0ddce4f156e9f2bfe2ca38db9479/recovered.edits] 2023-07-18 23:11:53,385 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/12791e0779a2553cc33b5959e56831d4/cf, FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/12791e0779a2553cc33b5959e56831d4/recovered.edits] 2023-07-18 23:11:53,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-18 23:11:53,390 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/dd5a0ddce4f156e9f2bfe2ca38db9479/cf/337108349cc646299c915d68eda8862e to hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/dd5a0ddce4f156e9f2bfe2ca38db9479/cf/337108349cc646299c915d68eda8862e 2023-07-18 23:11:53,390 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/12791e0779a2553cc33b5959e56831d4/cf/d10504456a964868a2a5129ecc199bd6 to hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/12791e0779a2553cc33b5959e56831d4/cf/d10504456a964868a2a5129ecc199bd6 2023-07-18 23:11:53,394 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/dd5a0ddce4f156e9f2bfe2ca38db9479/recovered.edits/9.seqid to hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/dd5a0ddce4f156e9f2bfe2ca38db9479/recovered.edits/9.seqid 2023-07-18 23:11:53,394 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/12791e0779a2553cc33b5959e56831d4/recovered.edits/9.seqid to hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/12791e0779a2553cc33b5959e56831d4/recovered.edits/9.seqid 2023-07-18 23:11:53,395 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/dd5a0ddce4f156e9f2bfe2ca38db9479 2023-07-18 23:11:53,395 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/12791e0779a2553cc33b5959e56831d4 2023-07-18 23:11:53,395 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-18 23:11:53,400 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:53,405 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-18 23:11:53,407 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-18 23:11:53,409 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:53,409 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-18 23:11:53,409 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689721888421.dd5a0ddce4f156e9f2bfe2ca38db9479.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689721913409"}]},"ts":"9223372036854775807"} 2023-07-18 23:11:53,409 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689721888421.12791e0779a2553cc33b5959e56831d4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689721913409"}]},"ts":"9223372036854775807"} 2023-07-18 23:11:53,411 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-18 23:11:53,411 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => dd5a0ddce4f156e9f2bfe2ca38db9479, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689721888421.dd5a0ddce4f156e9f2bfe2ca38db9479.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 12791e0779a2553cc33b5959e56831d4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689721888421.12791e0779a2553cc33b5959e56831d4.', STARTKEY => '1', ENDKEY => ''}] 2023-07-18 23:11:53,411 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-18 23:11:53,411 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689721913411"}]},"ts":"9223372036854775807"} 2023-07-18 23:11:53,414 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-18 23:11:53,417 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:53,418 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 44 msec 2023-07-18 23:11:53,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-18 23:11:53,487 INFO [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-18 23:11:53,498 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-18 23:11:53,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:53,501 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-18 23:11:53,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 23:11:53,513 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-18 23:11:53,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 23:11:53,566 INFO [Listener at jenkins-hbase4.apache.org/33217] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=762 (was 748) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-702194233_17 at /127.0.0.1:46724 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x32c52efa-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1573949030_1 at /127.0.0.1:42616 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x32c52efa-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-702194233_17 at /127.0.0.1:47456 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x32c52efa-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x32c52efa-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3828 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x32c52efa-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (337744187) connection to jenkins-hbase4.apache.org/172.31.14.131:45611 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (337744187) connection to jenkins-hbase4.apache.org/172.31.14.131:43013 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x32c52efa-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-702194233_17 at /127.0.0.1:42654 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1573949030_1 at /127.0.0.1:46718 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=910 (was 895) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=586 (was 409) - SystemLoadAverage LEAK? -, ProcessCount=187 (was 185) - ProcessCount LEAK? -, AvailableMemoryMB=2059 (was 2843) 2023-07-18 23:11:53,566 WARN [Listener at jenkins-hbase4.apache.org/33217] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-18 23:11:53,594 INFO [Listener at jenkins-hbase4.apache.org/33217] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=762, OpenFileDescriptor=910, MaxFileDescriptor=60000, SystemLoadAverage=586, ProcessCount=188, AvailableMemoryMB=2055 2023-07-18 23:11:53,594 WARN [Listener at jenkins-hbase4.apache.org/33217] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-18 23:11:53,600 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-18 23:11:53,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-18 23:11:53,614 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 23:11:53,615 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 23:11:53,619 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-18 23:11:53,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-18 23:11:53,621 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testEmptyExportFileSystemState/100ddfebe3307ec17b7b04df7f527464 2023-07-18 23:11:53,621 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testEmptyExportFileSystemState/22548ea393e8d556ca6ac256fce8000e 2023-07-18 23:11:53,622 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testEmptyExportFileSystemState/100ddfebe3307ec17b7b04df7f527464 empty. 2023-07-18 23:11:53,622 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testEmptyExportFileSystemState/100ddfebe3307ec17b7b04df7f527464 2023-07-18 23:11:53,622 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testEmptyExportFileSystemState/22548ea393e8d556ca6ac256fce8000e empty. 2023-07-18 23:11:53,623 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testEmptyExportFileSystemState/22548ea393e8d556ca6ac256fce8000e 2023-07-18 23:11:53,623 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-18 23:11:53,679 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-18 23:11:53,696 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 100ddfebe3307ec17b7b04df7f527464, NAME => 'testtb-testEmptyExportFileSystemState,,1689721913599.100ddfebe3307ec17b7b04df7f527464.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp 2023-07-18 23:11:53,696 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 22548ea393e8d556ca6ac256fce8000e, NAME => 'testtb-testEmptyExportFileSystemState,1,1689721913599.22548ea393e8d556ca6ac256fce8000e.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp 2023-07-18 23:11:53,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-18 23:11:53,758 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689721913599.100ddfebe3307ec17b7b04df7f527464.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 23:11:53,758 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 100ddfebe3307ec17b7b04df7f527464, disabling compactions & flushes 2023-07-18 23:11:53,758 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689721913599.100ddfebe3307ec17b7b04df7f527464. 2023-07-18 23:11:53,759 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689721913599.100ddfebe3307ec17b7b04df7f527464. 2023-07-18 23:11:53,759 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689721913599.100ddfebe3307ec17b7b04df7f527464. after waiting 0 ms 2023-07-18 23:11:53,759 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689721913599.100ddfebe3307ec17b7b04df7f527464. 2023-07-18 23:11:53,759 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689721913599.100ddfebe3307ec17b7b04df7f527464. 2023-07-18 23:11:53,759 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 100ddfebe3307ec17b7b04df7f527464: 2023-07-18 23:11:53,760 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689721913599.22548ea393e8d556ca6ac256fce8000e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 23:11:53,761 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 22548ea393e8d556ca6ac256fce8000e, disabling compactions & flushes 2023-07-18 23:11:53,761 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689721913599.22548ea393e8d556ca6ac256fce8000e. 2023-07-18 23:11:53,761 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689721913599.22548ea393e8d556ca6ac256fce8000e. 2023-07-18 23:11:53,761 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689721913599.22548ea393e8d556ca6ac256fce8000e. after waiting 0 ms 2023-07-18 23:11:53,761 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689721913599.22548ea393e8d556ca6ac256fce8000e. 2023-07-18 23:11:53,761 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689721913599.22548ea393e8d556ca6ac256fce8000e. 2023-07-18 23:11:53,761 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 22548ea393e8d556ca6ac256fce8000e: 2023-07-18 23:11:53,763 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 23:11:53,764 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689721913599.100ddfebe3307ec17b7b04df7f527464.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689721913764"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689721913764"}]},"ts":"1689721913764"} 2023-07-18 23:11:53,764 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689721913599.22548ea393e8d556ca6ac256fce8000e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689721913764"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689721913764"}]},"ts":"1689721913764"} 2023-07-18 23:11:53,767 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-18 23:11:53,768 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 23:11:53,768 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689721913768"}]},"ts":"1689721913768"} 2023-07-18 23:11:53,769 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-18 23:11:53,772 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 23:11:53,773 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 23:11:53,773 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 23:11:53,773 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 23:11:53,774 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 23:11:53,774 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=100ddfebe3307ec17b7b04df7f527464, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=22548ea393e8d556ca6ac256fce8000e, ASSIGN}] 2023-07-18 23:11:53,776 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=100ddfebe3307ec17b7b04df7f527464, ASSIGN 2023-07-18 23:11:53,776 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=22548ea393e8d556ca6ac256fce8000e, ASSIGN 2023-07-18 23:11:53,777 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=100ddfebe3307ec17b7b04df7f527464, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45387,1689721809516; forceNewPlan=false, retain=false 2023-07-18 23:11:53,777 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=22548ea393e8d556ca6ac256fce8000e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45431,1689721809599; forceNewPlan=false, retain=false 2023-07-18 23:11:53,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-18 23:11:53,927 INFO [jenkins-hbase4:46651] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-18 23:11:53,930 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=22548ea393e8d556ca6ac256fce8000e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:53,930 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=100ddfebe3307ec17b7b04df7f527464, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:53,931 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689721913599.100ddfebe3307ec17b7b04df7f527464.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689721913930"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689721913930"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689721913930"}]},"ts":"1689721913930"} 2023-07-18 23:11:53,931 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689721913599.22548ea393e8d556ca6ac256fce8000e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689721913930"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689721913930"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689721913930"}]},"ts":"1689721913930"} 2023-07-18 23:11:53,932 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure 22548ea393e8d556ca6ac256fce8000e, server=jenkins-hbase4.apache.org,45431,1689721809599}] 2023-07-18 23:11:53,936 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 100ddfebe3307ec17b7b04df7f527464, server=jenkins-hbase4.apache.org,45387,1689721809516}] 2023-07-18 23:11:54,090 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689721913599.100ddfebe3307ec17b7b04df7f527464. 2023-07-18 23:11:54,090 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689721913599.22548ea393e8d556ca6ac256fce8000e. 2023-07-18 23:11:54,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 100ddfebe3307ec17b7b04df7f527464, NAME => 'testtb-testEmptyExportFileSystemState,,1689721913599.100ddfebe3307ec17b7b04df7f527464.', STARTKEY => '', ENDKEY => '1'} 2023-07-18 23:11:54,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 22548ea393e8d556ca6ac256fce8000e, NAME => 'testtb-testEmptyExportFileSystemState,1,1689721913599.22548ea393e8d556ca6ac256fce8000e.', STARTKEY => '1', ENDKEY => ''} 2023-07-18 23:11:54,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689721913599.100ddfebe3307ec17b7b04df7f527464. service=AccessControlService 2023-07-18 23:11:54,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689721913599.22548ea393e8d556ca6ac256fce8000e. service=AccessControlService 2023-07-18 23:11:54,091 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 23:11:54,091 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 23:11:54,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 100ddfebe3307ec17b7b04df7f527464 2023-07-18 23:11:54,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 22548ea393e8d556ca6ac256fce8000e 2023-07-18 23:11:54,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689721913599.100ddfebe3307ec17b7b04df7f527464.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 23:11:54,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689721913599.22548ea393e8d556ca6ac256fce8000e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 23:11:54,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 100ddfebe3307ec17b7b04df7f527464 2023-07-18 23:11:54,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 22548ea393e8d556ca6ac256fce8000e 2023-07-18 23:11:54,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 22548ea393e8d556ca6ac256fce8000e 2023-07-18 23:11:54,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 100ddfebe3307ec17b7b04df7f527464 2023-07-18 23:11:54,092 INFO [StoreOpener-100ddfebe3307ec17b7b04df7f527464-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 100ddfebe3307ec17b7b04df7f527464 2023-07-18 23:11:54,092 INFO [StoreOpener-22548ea393e8d556ca6ac256fce8000e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 22548ea393e8d556ca6ac256fce8000e 2023-07-18 23:11:54,094 DEBUG [StoreOpener-22548ea393e8d556ca6ac256fce8000e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testEmptyExportFileSystemState/22548ea393e8d556ca6ac256fce8000e/cf 2023-07-18 23:11:54,094 DEBUG [StoreOpener-100ddfebe3307ec17b7b04df7f527464-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testEmptyExportFileSystemState/100ddfebe3307ec17b7b04df7f527464/cf 2023-07-18 23:11:54,094 DEBUG [StoreOpener-22548ea393e8d556ca6ac256fce8000e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testEmptyExportFileSystemState/22548ea393e8d556ca6ac256fce8000e/cf 2023-07-18 23:11:54,094 DEBUG [StoreOpener-100ddfebe3307ec17b7b04df7f527464-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testEmptyExportFileSystemState/100ddfebe3307ec17b7b04df7f527464/cf 2023-07-18 23:11:54,094 INFO [StoreOpener-22548ea393e8d556ca6ac256fce8000e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 22548ea393e8d556ca6ac256fce8000e columnFamilyName cf 2023-07-18 23:11:54,094 INFO [StoreOpener-100ddfebe3307ec17b7b04df7f527464-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 100ddfebe3307ec17b7b04df7f527464 columnFamilyName cf 2023-07-18 23:11:54,095 INFO [StoreOpener-22548ea393e8d556ca6ac256fce8000e-1] regionserver.HStore(310): Store=22548ea393e8d556ca6ac256fce8000e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 23:11:54,095 INFO [StoreOpener-100ddfebe3307ec17b7b04df7f527464-1] regionserver.HStore(310): Store=100ddfebe3307ec17b7b04df7f527464/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 23:11:54,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testEmptyExportFileSystemState/22548ea393e8d556ca6ac256fce8000e 2023-07-18 23:11:54,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testEmptyExportFileSystemState/100ddfebe3307ec17b7b04df7f527464 2023-07-18 23:11:54,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testEmptyExportFileSystemState/22548ea393e8d556ca6ac256fce8000e 2023-07-18 23:11:54,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testEmptyExportFileSystemState/100ddfebe3307ec17b7b04df7f527464 2023-07-18 23:11:54,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 22548ea393e8d556ca6ac256fce8000e 2023-07-18 23:11:54,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 100ddfebe3307ec17b7b04df7f527464 2023-07-18 23:11:54,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testEmptyExportFileSystemState/100ddfebe3307ec17b7b04df7f527464/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 23:11:54,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testEmptyExportFileSystemState/22548ea393e8d556ca6ac256fce8000e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 23:11:54,101 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 100ddfebe3307ec17b7b04df7f527464; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72759475, jitterRate=0.0842006653547287}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 23:11:54,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 100ddfebe3307ec17b7b04df7f527464: 2023-07-18 23:11:54,101 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 22548ea393e8d556ca6ac256fce8000e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70340951, jitterRate=0.04816184937953949}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 23:11:54,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 22548ea393e8d556ca6ac256fce8000e: 2023-07-18 23:11:54,102 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689721913599.100ddfebe3307ec17b7b04df7f527464., pid=94, masterSystemTime=1689721914087 2023-07-18 23:11:54,102 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689721913599.22548ea393e8d556ca6ac256fce8000e., pid=93, masterSystemTime=1689721914087 2023-07-18 23:11:54,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689721913599.100ddfebe3307ec17b7b04df7f527464. 2023-07-18 23:11:54,103 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689721913599.100ddfebe3307ec17b7b04df7f527464. 2023-07-18 23:11:54,104 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=100ddfebe3307ec17b7b04df7f527464, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:54,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689721913599.22548ea393e8d556ca6ac256fce8000e. 2023-07-18 23:11:54,104 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689721913599.100ddfebe3307ec17b7b04df7f527464.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689721914104"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689721914104"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689721914104"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689721914104"}]},"ts":"1689721914104"} 2023-07-18 23:11:54,104 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689721913599.22548ea393e8d556ca6ac256fce8000e. 2023-07-18 23:11:54,104 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=22548ea393e8d556ca6ac256fce8000e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:54,104 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689721913599.22548ea393e8d556ca6ac256fce8000e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689721914104"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689721914104"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689721914104"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689721914104"}]},"ts":"1689721914104"} 2023-07-18 23:11:54,107 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-07-18 23:11:54,107 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 100ddfebe3307ec17b7b04df7f527464, server=jenkins-hbase4.apache.org,45387,1689721809516 in 169 msec 2023-07-18 23:11:54,108 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=92 2023-07-18 23:11:54,109 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=100ddfebe3307ec17b7b04df7f527464, ASSIGN in 333 msec 2023-07-18 23:11:54,109 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure 22548ea393e8d556ca6ac256fce8000e, server=jenkins-hbase4.apache.org,45431,1689721809599 in 174 msec 2023-07-18 23:11:54,110 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-18 23:11:54,110 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=22548ea393e8d556ca6ac256fce8000e, ASSIGN in 335 msec 2023-07-18 23:11:54,111 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 23:11:54,111 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689721914111"}]},"ts":"1689721914111"} 2023-07-18 23:11:54,112 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-18 23:11:54,115 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 23:11:54,115 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-18 23:11:54,117 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45387] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-18 23:11:54,118 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 23:11:54,118 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 23:11:54,119 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 23:11:54,119 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 23:11:54,120 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-18 23:11:54,120 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-18 23:11:54,120 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-18 23:11:54,120 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-18 23:11:54,122 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 520 msec 2023-07-18 23:11:54,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-18 23:11:54,227 INFO [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-18 23:11:54,227 DEBUG [Listener at jenkins-hbase4.apache.org/33217] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testEmptyExportFileSystemState get assigned. Timeout = 60000ms 2023-07-18 23:11:54,228 INFO [Listener at jenkins-hbase4.apache.org/33217] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 23:11:54,231 INFO [Listener at jenkins-hbase4.apache.org/33217] hbase.HBaseTestingUtility(3484): All regions for table testtb-testEmptyExportFileSystemState assigned to meta. Checking AM states. 2023-07-18 23:11:54,232 INFO [Listener at jenkins-hbase4.apache.org/33217] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 23:11:54,232 INFO [Listener at jenkins-hbase4.apache.org/33217] hbase.HBaseTestingUtility(3504): All regions for table testtb-testEmptyExportFileSystemState assigned. 2023-07-18 23:11:54,234 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 23:11:54,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689721914234 (current time:1689721914234). 2023-07-18 23:11:54,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 23:11:54,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(139): Connect 0x527cf2f7 to 127.0.0.1:61306 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 23:11:54,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7acb1a65, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 23:11:54,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 23:11:54,247 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50850, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 23:11:54,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x527cf2f7 to 127.0.0.1:61306 2023-07-18 23:11:54,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 23:11:54,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(139): Connect 0x70af9424 to 127.0.0.1:61306 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 23:11:54,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@45713b8c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 23:11:54,256 DEBUG [hconnection-0x67cb1975-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 23:11:54,256 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50858, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 23:11:54,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x70af9424 to 127.0.0.1:61306 2023-07-18 23:11:54,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 23:11:54,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-18 23:11:54,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 23:11:54,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 23:11:54,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-18 23:11:54,266 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-18 23:11:54,267 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689722514267 2023-07-18 23:11:54,267 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-18 23:11:54,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 23:11:54,269 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 23:11:54,269 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 23:11:54,269 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-18 23:11:54,270 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-18 23:11:54,272 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-18 23:11:54,275 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-18 23:11:54,276 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689722514276 2023-07-18 23:11:54,286 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,286 INFO [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-18 23:11:54,286 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 23:11:54,288 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-18 23:11:54,288 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-18 23:11:54,288 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,288 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,295 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:11:54,295 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:11:54,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:11:54,295 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:54,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:11:54,295 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:11:54,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:11:54,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:11:54,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:11:54,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:11:54,295 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:54,295 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:54,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,296 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,296 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:54,296 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 23:11:54,296 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,296 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-18 23:11:54,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-18 23:11:54,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-18 23:11:54,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,296 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-18 23:11:54,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,297 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-18 23:11:54,297 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-18 23:11:54,297 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,297 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,297 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-18 23:11:54,297 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 23:11:54,297 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-18 23:11:54,299 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-18 23:11:54,299 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-18 23:11:54,297 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,299 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45431,1689721809599' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-18 23:11:54,299 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 23:11:54,299 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-18 23:11:54,300 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-18 23:11:54,300 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 23:11:54,300 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-18 23:11:54,302 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-18 23:11:54,302 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-18 23:11:54,302 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45387,1689721809516' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-18 23:11:54,302 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38625,1689721809654' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-18 23:11:54,304 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:54,304 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:54,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:11:54,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:11:54,310 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:54,311 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,311 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,311 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,311 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 23:11:54,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:11:54,311 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,311 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,311 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 23:11:54,311 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 23:11:54,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:11:54,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:54,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:54,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:54,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:11:54,314 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45431,1689721809599' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-18 23:11:54,314 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f435036[Count = 1] remaining members to acquire global barrier 2023-07-18 23:11:54,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:54,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:11:54,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:11:54,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:11:54,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:11:54,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:54,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:54,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:54,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:11:54,316 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45387,1689721809516' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-18 23:11:54,316 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f435036[Count = 0] remaining members to acquire global barrier 2023-07-18 23:11:54,316 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-18 23:11:54,316 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,319 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,319 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,319 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,319 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-18 23:11:54,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,319 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:54,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,319 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-18 23:11:54,319 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689721913599.22548ea393e8d556ca6ac256fce8000e. 2023-07-18 23:11:54,319 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-18 23:11:54,319 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 23:11:54,320 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 23:11:54,320 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689721913599.100ddfebe3307ec17b7b04df7f527464. 2023-07-18 23:11:54,319 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 23:11:54,320 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689721913599.100ddfebe3307ec17b7b04df7f527464. started... 2023-07-18 23:11:54,320 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 23:11:54,319 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689721913599.22548ea393e8d556ca6ac256fce8000e. started... 2023-07-18 23:11:54,322 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 100ddfebe3307ec17b7b04df7f527464: 2023-07-18 23:11:54,319 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-18 23:11:54,323 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 22548ea393e8d556ca6ac256fce8000e: 2023-07-18 23:11:54,319 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:54,324 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 23:11:54,324 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689721913599.22548ea393e8d556ca6ac256fce8000e.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,324 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689721913599.100ddfebe3307ec17b7b04df7f527464.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,323 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38625,1689721809654' in zk 2023-07-18 23:11:54,324 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 23:11:54,324 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 23:11:54,324 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 23:11:54,326 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 23:11:54,334 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-18 23:11:54,334 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 23:11:54,334 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-18 23:11:54,365 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689721913599.22548ea393e8d556ca6ac256fce8000e. completed. 2023-07-18 23:11:54,366 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689721913599.22548ea393e8d556ca6ac256fce8000e. 2023-07-18 23:11:54,366 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 23:11:54,366 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 23:11:54,366 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:54,366 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-18 23:11:54,366 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45431,1689721809599' in zk 2023-07-18 23:11:54,366 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689721913599.100ddfebe3307ec17b7b04df7f527464. completed. 2023-07-18 23:11:54,366 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689721913599.100ddfebe3307ec17b7b04df7f527464. 2023-07-18 23:11:54,367 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 23:11:54,367 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 23:11:54,367 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:54,367 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-18 23:11:54,367 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45387,1689721809516' in zk 2023-07-18 23:11:54,368 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-18 23:11:54,368 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:54,368 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 23:11:54,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:54,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:11:54,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:11:54,368 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-18 23:11:54,369 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 23:11:54,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 23:11:54,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-18 23:11:54,371 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 23:11:54,371 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:54,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:11:54,371 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-18 23:11:54,371 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 23:11:54,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:11:54,371 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-18 23:11:54,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:54,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:54,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:54,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:11:54,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:54,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:54,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:54,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,45431,1689721809599': 2023-07-18 23:11:54,376 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45431,1689721809599' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-18 23:11:54,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:54,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:11:54,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:11:54,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:11:54,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:11:54,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:54,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:54,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:54,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:11:54,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:54,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:54,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:54,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,45387,1689721809516': 2023-07-18 23:11:54,381 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45387,1689721809516' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-18 23:11:54,381 INFO [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-18 23:11:54,381 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 23:11:54,381 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 23:11:54,381 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,381 INFO [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 23:11:54,385 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,385 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:11:54,385 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,385 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:11:54,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:11:54,385 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:11:54,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:11:54,386 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:54,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:11:54,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:11:54,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,386 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:54,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:11:54,386 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:54,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:54,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:54,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:54,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:11:54,388 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:54,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,390 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:54,391 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,391 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:11:54,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:54,391 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:54,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:11:54,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:11:54,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:54,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:11:54,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:11:54,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:54,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,396 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:54,396 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,396 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:54,396 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:54,396 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:11:54,396 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:11:54,396 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 23:11:54,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:11:54,396 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:11:54,396 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,396 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:11:54,398 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,396 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:11:54,396 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:11:54,398 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:11:54,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:11:54,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:11:54,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:11:54,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:11:54,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:11:54,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:11:54,398 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:54,399 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,399 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:54,399 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:54,399 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,399 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,399 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:11:54,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:11:54,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:11:54,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:11:54,458 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,489 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-18 23:11:54,489 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,489 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,490 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689721914267Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689721914398 (+131 ms)Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689721914398Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689721914408 (+10 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689721914450 (+42 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689721914489 (+39 ms) 2023-07-18 23:11:54,493 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-18 23:11:54,494 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 225 msec 2023-07-18 23:11:54,571 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 23:11:54,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 23:11:54,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 23:11:54,579 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45387] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689721913599.100ddfebe3307ec17b7b04df7f527464. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 23:11:54,580 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45431] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689721913599.22548ea393e8d556ca6ac256fce8000e. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 23:11:54,583 DEBUG [Listener at jenkins-hbase4.apache.org/33217] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-18 23:11:54,584 DEBUG [Listener at jenkins-hbase4.apache.org/33217] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689721913599.100ddfebe3307ec17b7b04df7f527464. 2023-07-18 23:11:54,585 INFO [Listener at jenkins-hbase4.apache.org/33217] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 23:11:54,596 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 23:11:54,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689721914596 (current time:1689721914596). 2023-07-18 23:11:54,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 23:11:54,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(139): Connect 0x7724a93b to 127.0.0.1:61306 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 23:11:54,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@489b061b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 23:11:54,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 23:11:54,610 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50862, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 23:11:54,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7724a93b to 127.0.0.1:61306 2023-07-18 23:11:54,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 23:11:54,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(139): Connect 0x51639a12 to 127.0.0.1:61306 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 23:11:54,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3dc8c74, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 23:11:54,621 DEBUG [hconnection-0x13e7e9ca-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 23:11:54,624 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50874, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 23:11:54,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x51639a12 to 127.0.0.1:61306 2023-07-18 23:11:54,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 23:11:54,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-18 23:11:54,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 23:11:54,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 23:11:54,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-18 23:11:54,632 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-18 23:11:54,635 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689722514635 2023-07-18 23:11:54,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 23:11:54,635 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-18 23:11:54,636 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 23:11:54,636 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 23:11:54,638 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-18 23:11:54,638 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-18 23:11:54,639 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-07-18 23:11:54,640 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-18 23:11:54,641 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689722514641 2023-07-18 23:11:54,665 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,665 INFO [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-18 23:11:54,665 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 23:11:54,667 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-18 23:11:54,667 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-18 23:11:54,668 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,668 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,669 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:11:54,669 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:54,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:11:54,669 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:11:54,669 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:11:54,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:11:54,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:11:54,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:11:54,669 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:54,670 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:54,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:11:54,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:11:54,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,670 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:54,670 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 23:11:54,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,670 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,670 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,671 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-18 23:11:54,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-18 23:11:54,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-18 23:11:54,671 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-18 23:11:54,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,671 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-18 23:11:54,671 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-18 23:11:54,671 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,671 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-18 23:11:54,671 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,671 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 23:11:54,671 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-18 23:11:54,671 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,673 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-18 23:11:54,673 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-18 23:11:54,673 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-18 23:11:54,673 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 23:11:54,673 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45387,1689721809516' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-18 23:11:54,675 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-18 23:11:54,673 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 23:11:54,675 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-18 23:11:54,680 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45431,1689721809599' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-18 23:11:54,680 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-18 23:11:54,680 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-18 23:11:54,680 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38625,1689721809654' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-18 23:11:54,682 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:54,682 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:54,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:11:54,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:11:54,683 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:54,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:11:54,683 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,683 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 23:11:54,683 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,683 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:11:54,684 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,684 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,684 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 23:11:54,684 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 23:11:54,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:54,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:54,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:54,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:11:54,685 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45387,1689721809516' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-18 23:11:54,685 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@346a6015[Count = 1] remaining members to acquire global barrier 2023-07-18 23:11:54,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:54,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:11:54,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:11:54,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:11:54,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:11:54,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:54,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:54,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:54,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:11:54,687 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45431,1689721809599' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-18 23:11:54,687 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@346a6015[Count = 0] remaining members to acquire global barrier 2023-07-18 23:11:54,687 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-18 23:11:54,687 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,692 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,692 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,692 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,692 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-18 23:11:54,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,692 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:54,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,692 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 23:11:54,692 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689721913599.22548ea393e8d556ca6ac256fce8000e. 2023-07-18 23:11:54,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,693 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689721913599.22548ea393e8d556ca6ac256fce8000e. started... 2023-07-18 23:11:54,692 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 23:11:54,692 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-18 23:11:54,693 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:54,693 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 23:11:54,693 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-18 23:11:54,693 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 23:11:54,693 INFO [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 22548ea393e8d556ca6ac256fce8000e 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-18 23:11:54,693 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689721913599.100ddfebe3307ec17b7b04df7f527464. 2023-07-18 23:11:54,693 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 23:11:54,693 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-18 23:11:54,693 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38625,1689721809654' in zk 2023-07-18 23:11:54,693 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689721913599.100ddfebe3307ec17b7b04df7f527464. started... 2023-07-18 23:11:54,693 INFO [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 100ddfebe3307ec17b7b04df7f527464 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-18 23:11:54,695 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-18 23:11:54,695 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 23:11:54,695 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-18 23:11:54,741 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 23:11:54,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 23:11:54,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-18 23:11:54,743 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 23:11:54,747 INFO [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.93 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testEmptyExportFileSystemState/22548ea393e8d556ca6ac256fce8000e/.tmp/cf/bd5934169268462595aac9ee92a9cc34 2023-07-18 23:11:54,751 INFO [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=333 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testEmptyExportFileSystemState/100ddfebe3307ec17b7b04df7f527464/.tmp/cf/c53e640b731e4e5181af930dad0c1a44 2023-07-18 23:11:54,760 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testEmptyExportFileSystemState/22548ea393e8d556ca6ac256fce8000e/.tmp/cf/bd5934169268462595aac9ee92a9cc34 as hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testEmptyExportFileSystemState/22548ea393e8d556ca6ac256fce8000e/cf/bd5934169268462595aac9ee92a9cc34 2023-07-18 23:11:54,761 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testEmptyExportFileSystemState/100ddfebe3307ec17b7b04df7f527464/.tmp/cf/c53e640b731e4e5181af930dad0c1a44 as hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testEmptyExportFileSystemState/100ddfebe3307ec17b7b04df7f527464/cf/c53e640b731e4e5181af930dad0c1a44 2023-07-18 23:11:54,765 INFO [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testEmptyExportFileSystemState/22548ea393e8d556ca6ac256fce8000e/cf/bd5934169268462595aac9ee92a9cc34, entries=45, sequenceid=6, filesize=7.9 K 2023-07-18 23:11:54,766 INFO [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 22548ea393e8d556ca6ac256fce8000e in 73ms, sequenceid=6, compaction requested=false 2023-07-18 23:11:54,767 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-18 23:11:54,767 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 22548ea393e8d556ca6ac256fce8000e: 2023-07-18 23:11:54,767 INFO [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testEmptyExportFileSystemState/100ddfebe3307ec17b7b04df7f527464/cf/c53e640b731e4e5181af930dad0c1a44, entries=5, sequenceid=6, filesize=5.2 K 2023-07-18 23:11:54,767 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689721913599.22548ea393e8d556ca6ac256fce8000e.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,768 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 23:11:54,768 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testEmptyExportFileSystemState/22548ea393e8d556ca6ac256fce8000e/cf/bd5934169268462595aac9ee92a9cc34] hfiles 2023-07-18 23:11:54,768 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testEmptyExportFileSystemState/22548ea393e8d556ca6ac256fce8000e/cf/bd5934169268462595aac9ee92a9cc34 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,768 INFO [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 100ddfebe3307ec17b7b04df7f527464 in 75ms, sequenceid=6, compaction requested=false 2023-07-18 23:11:54,771 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 100ddfebe3307ec17b7b04df7f527464: 2023-07-18 23:11:54,772 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689721913599.100ddfebe3307ec17b7b04df7f527464.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,772 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 23:11:54,772 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testEmptyExportFileSystemState/100ddfebe3307ec17b7b04df7f527464/cf/c53e640b731e4e5181af930dad0c1a44] hfiles 2023-07-18 23:11:54,772 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testEmptyExportFileSystemState/100ddfebe3307ec17b7b04df7f527464/cf/c53e640b731e4e5181af930dad0c1a44 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,787 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689721913599.22548ea393e8d556ca6ac256fce8000e. completed. 2023-07-18 23:11:54,787 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689721913599.22548ea393e8d556ca6ac256fce8000e. 2023-07-18 23:11:54,787 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 23:11:54,787 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 23:11:54,787 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:54,790 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-18 23:11:54,790 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45431,1689721809599' in zk 2023-07-18 23:11:54,792 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-18 23:11:54,792 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:54,792 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 23:11:54,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:54,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:11:54,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:11:54,792 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-18 23:11:54,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:11:54,794 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689721913599.100ddfebe3307ec17b7b04df7f527464. completed. 2023-07-18 23:11:54,795 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689721809516)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689721913599.100ddfebe3307ec17b7b04df7f527464. 2023-07-18 23:11:54,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:11:54,795 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 23:11:54,795 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 23:11:54,795 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:54,795 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-18 23:11:54,795 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45387,1689721809516' in zk 2023-07-18 23:11:54,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:54,796 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-18 23:11:54,796 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:54,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:54,797 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 23:11:54,797 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-18 23:11:54,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:54,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:11:54,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:54,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:54,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:54,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,45431,1689721809599': 2023-07-18 23:11:54,801 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45431,1689721809599' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-18 23:11:54,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:54,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:11:54,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:11:54,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:11:54,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:11:54,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:54,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:54,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:54,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:11:54,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:54,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:54,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:54,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,45387,1689721809516': 2023-07-18 23:11:54,804 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45387,1689721809516' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-18 23:11:54,804 INFO [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-18 23:11:54,804 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 23:11:54,804 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 23:11:54,804 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,804 INFO [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 23:11:54,806 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,806 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,806 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:11:54,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:11:54,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,806 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,807 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:11:54,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,806 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:11:54,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,807 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:54,806 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:11:54,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:11:54,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:11:54,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:11:54,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:11:54,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:11:54,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:11:54,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:11:54,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,808 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:54,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:11:54,808 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:54,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:54,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:54,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:54,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:11:54,810 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:54,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,810 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:54,810 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:54,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:54,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:54,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:54,818 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:11:54,818 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:54,818 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:11:54,818 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,818 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:11:54,818 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:54,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:11:54,818 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:54,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:11:54,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:11:54,818 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:11:54,818 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:11:54,819 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:11:54,818 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,819 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:11:54,819 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,819 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:11:54,819 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,819 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:11:54,819 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:11:54,819 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,819 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:11:54,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:11:54,819 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 23:11:54,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:11:54,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:11:54,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:11:54,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:11:54,823 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:11:54,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:11:54,865 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,904 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-18 23:11:54,904 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,904 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,905 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689721914635Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689721914819 (+184 ms)Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689721914819Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689721914826 (+7 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689721914856 (+30 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689721914904 (+48 ms) 2023-07-18 23:11:54,908 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-18 23:11:54,910 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 272 msec 2023-07-18 23:11:54,943 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 23:11:54,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 23:11:54,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 23:11:54,944 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/export-test/export-1689721914944 2023-07-18 23:11:54,944 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45655, tgtDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/export-test/export-1689721914944, rawTgtDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/export-test/export-1689721914944, srcFsUri=hdfs://localhost:45655, srcDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054 2023-07-18 23:11:54,972 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45655, inputRoot=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054 2023-07-18 23:11:54,972 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_775885964_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/export-test/export-1689721914944, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/export-test/export-1689721914944/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:54,972 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45655, inputRoot=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054, snapshotDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-18 23:11:54,979 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/export-test/export-1689721914944/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:11:55,016 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-18 23:11:55,017 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-18 23:11:55,017 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-18 23:11:55,017 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-18 23:11:56,054 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/hadoop-8909297752759458493.jar 2023-07-18 23:11:56,054 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-18 23:11:56,055 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-18 23:11:56,130 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/hadoop-8020392166565072823.jar 2023-07-18 23:11:56,130 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-18 23:11:56,131 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-18 23:11:56,131 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-18 23:11:56,131 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-18 23:11:56,132 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-18 23:11:56,132 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-18 23:11:56,132 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-18 23:11:56,133 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-18 23:11:56,133 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-18 23:11:56,133 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-18 23:11:56,134 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-18 23:11:56,134 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-18 23:11:56,135 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-18 23:11:56,135 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-18 23:11:56,135 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-18 23:11:56,136 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-18 23:11:56,136 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 23:11:56,137 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 23:11:56,137 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 23:11:56,138 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 23:11:56,138 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 23:11:56,138 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 23:11:56,139 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 23:11:56,929 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689721818645_0005_000001 (auth:SIMPLE) 2023-07-18 23:11:58,151 WARN [Listener at jenkins-hbase4.apache.org/33217] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-18 23:11:58,156 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-18 23:11:58,266 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 23:11:58,267 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 23:11:58,445 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 23:11:58,724 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689721818645_0006_000001 (auth:SIMPLE) 2023-07-18 23:12:05,217 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689721818645_0006_000001 (auth:SIMPLE) 2023-07-18 23:12:08,471 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-18 23:12:08,472 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-18 23:12:08,479 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:12:08,479 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-18 23:12:08,480 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-18 23:12:08,480 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-702194233_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:12:08,480 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(367): hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-18 23:12:08,481 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(367): hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-18 23:12:08,481 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-702194233_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/export-test/export-1689721914944/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/export-test/export-1689721914944/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:12:08,481 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(367): hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/export-test/export-1689721914944/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-18 23:12:08,481 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(367): hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/export-test/export-1689721914944/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-18 23:12:08,486 INFO [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-18 23:12:08,486 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-18 23:12:08,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-18 23:12:08,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-18 23:12:08,491 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689721928491"}]},"ts":"1689721928491"} 2023-07-18 23:12:08,492 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-18 23:12:08,494 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-18 23:12:08,495 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=100ddfebe3307ec17b7b04df7f527464, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=22548ea393e8d556ca6ac256fce8000e, UNASSIGN}] 2023-07-18 23:12:08,500 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=22548ea393e8d556ca6ac256fce8000e, UNASSIGN 2023-07-18 23:12:08,500 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=100ddfebe3307ec17b7b04df7f527464, UNASSIGN 2023-07-18 23:12:08,502 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=100ddfebe3307ec17b7b04df7f527464, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:12:08,502 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=22548ea393e8d556ca6ac256fce8000e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:12:08,502 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689721913599.100ddfebe3307ec17b7b04df7f527464.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689721928502"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689721928502"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689721928502"}]},"ts":"1689721928502"} 2023-07-18 23:12:08,502 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689721913599.22548ea393e8d556ca6ac256fce8000e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689721928502"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689721928502"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689721928502"}]},"ts":"1689721928502"} 2023-07-18 23:12:08,504 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 100ddfebe3307ec17b7b04df7f527464, server=jenkins-hbase4.apache.org,45387,1689721809516}] 2023-07-18 23:12:08,505 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 22548ea393e8d556ca6ac256fce8000e, server=jenkins-hbase4.apache.org,45431,1689721809599}] 2023-07-18 23:12:08,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-18 23:12:08,657 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 100ddfebe3307ec17b7b04df7f527464 2023-07-18 23:12:08,657 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 100ddfebe3307ec17b7b04df7f527464, disabling compactions & flushes 2023-07-18 23:12:08,657 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689721913599.100ddfebe3307ec17b7b04df7f527464. 2023-07-18 23:12:08,657 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689721913599.100ddfebe3307ec17b7b04df7f527464. 2023-07-18 23:12:08,657 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689721913599.100ddfebe3307ec17b7b04df7f527464. after waiting 0 ms 2023-07-18 23:12:08,657 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689721913599.100ddfebe3307ec17b7b04df7f527464. 2023-07-18 23:12:08,658 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 22548ea393e8d556ca6ac256fce8000e 2023-07-18 23:12:08,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 22548ea393e8d556ca6ac256fce8000e, disabling compactions & flushes 2023-07-18 23:12:08,659 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689721913599.22548ea393e8d556ca6ac256fce8000e. 2023-07-18 23:12:08,662 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689721913599.22548ea393e8d556ca6ac256fce8000e. 2023-07-18 23:12:08,662 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689721913599.22548ea393e8d556ca6ac256fce8000e. after waiting 0 ms 2023-07-18 23:12:08,662 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689721913599.22548ea393e8d556ca6ac256fce8000e. 2023-07-18 23:12:08,675 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testEmptyExportFileSystemState/100ddfebe3307ec17b7b04df7f527464/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 23:12:08,676 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 23:12:08,677 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689721913599.100ddfebe3307ec17b7b04df7f527464. 2023-07-18 23:12:08,677 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 100ddfebe3307ec17b7b04df7f527464: 2023-07-18 23:12:08,678 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testEmptyExportFileSystemState/22548ea393e8d556ca6ac256fce8000e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 23:12:08,678 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 100ddfebe3307ec17b7b04df7f527464 2023-07-18 23:12:08,679 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 23:12:08,680 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689721913599.22548ea393e8d556ca6ac256fce8000e. 2023-07-18 23:12:08,680 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 22548ea393e8d556ca6ac256fce8000e: 2023-07-18 23:12:08,680 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=100ddfebe3307ec17b7b04df7f527464, regionState=CLOSED 2023-07-18 23:12:08,680 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689721913599.100ddfebe3307ec17b7b04df7f527464.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689721928680"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689721928680"}]},"ts":"1689721928680"} 2023-07-18 23:12:08,681 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 22548ea393e8d556ca6ac256fce8000e 2023-07-18 23:12:08,681 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=22548ea393e8d556ca6ac256fce8000e, regionState=CLOSED 2023-07-18 23:12:08,682 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689721913599.22548ea393e8d556ca6ac256fce8000e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689721928681"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689721928681"}]},"ts":"1689721928681"} 2023-07-18 23:12:08,684 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-18 23:12:08,684 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 100ddfebe3307ec17b7b04df7f527464, server=jenkins-hbase4.apache.org,45387,1689721809516 in 178 msec 2023-07-18 23:12:08,686 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-18 23:12:08,686 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=100ddfebe3307ec17b7b04df7f527464, UNASSIGN in 189 msec 2023-07-18 23:12:08,686 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 22548ea393e8d556ca6ac256fce8000e, server=jenkins-hbase4.apache.org,45431,1689721809599 in 179 msec 2023-07-18 23:12:08,688 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-18 23:12:08,688 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=22548ea393e8d556ca6ac256fce8000e, UNASSIGN in 191 msec 2023-07-18 23:12:08,689 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689721928688"}]},"ts":"1689721928688"} 2023-07-18 23:12:08,690 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-18 23:12:08,692 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-18 23:12:08,693 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 205 msec 2023-07-18 23:12:08,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-18 23:12:08,793 INFO [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-18 23:12:08,794 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-18 23:12:08,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-18 23:12:08,797 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-18 23:12:08,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-18 23:12:08,798 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-18 23:12:08,799 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45387] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-18 23:12:08,802 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testEmptyExportFileSystemState/22548ea393e8d556ca6ac256fce8000e 2023-07-18 23:12:08,802 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testEmptyExportFileSystemState/100ddfebe3307ec17b7b04df7f527464 2023-07-18 23:12:08,803 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-18 23:12:08,803 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-18 23:12:08,803 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-18 23:12:08,803 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-18 23:12:08,803 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-18 23:12:08,804 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-18 23:12:08,804 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-18 23:12:08,804 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-18 23:12:08,804 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testEmptyExportFileSystemState/22548ea393e8d556ca6ac256fce8000e/cf, FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testEmptyExportFileSystemState/22548ea393e8d556ca6ac256fce8000e/recovered.edits] 2023-07-18 23:12:08,804 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testEmptyExportFileSystemState/100ddfebe3307ec17b7b04df7f527464/cf, FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testEmptyExportFileSystemState/100ddfebe3307ec17b7b04df7f527464/recovered.edits] 2023-07-18 23:12:08,805 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-18 23:12:08,805 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-18 23:12:08,805 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 23:12:08,805 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-18 23:12:08,805 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-18 23:12:08,805 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 23:12:08,805 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 23:12:08,805 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 23:12:08,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-18 23:12:08,809 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testEmptyExportFileSystemState/100ddfebe3307ec17b7b04df7f527464/cf/c53e640b731e4e5181af930dad0c1a44 to hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/archive/data/default/testtb-testEmptyExportFileSystemState/100ddfebe3307ec17b7b04df7f527464/cf/c53e640b731e4e5181af930dad0c1a44 2023-07-18 23:12:08,812 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testEmptyExportFileSystemState/100ddfebe3307ec17b7b04df7f527464/recovered.edits/9.seqid to hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/archive/data/default/testtb-testEmptyExportFileSystemState/100ddfebe3307ec17b7b04df7f527464/recovered.edits/9.seqid 2023-07-18 23:12:08,813 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testEmptyExportFileSystemState/100ddfebe3307ec17b7b04df7f527464 2023-07-18 23:12:08,814 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testEmptyExportFileSystemState/22548ea393e8d556ca6ac256fce8000e/cf/bd5934169268462595aac9ee92a9cc34 to hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/archive/data/default/testtb-testEmptyExportFileSystemState/22548ea393e8d556ca6ac256fce8000e/cf/bd5934169268462595aac9ee92a9cc34 2023-07-18 23:12:08,818 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testEmptyExportFileSystemState/22548ea393e8d556ca6ac256fce8000e/recovered.edits/9.seqid to hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/archive/data/default/testtb-testEmptyExportFileSystemState/22548ea393e8d556ca6ac256fce8000e/recovered.edits/9.seqid 2023-07-18 23:12:08,818 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testEmptyExportFileSystemState/22548ea393e8d556ca6ac256fce8000e 2023-07-18 23:12:08,819 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-18 23:12:08,821 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-18 23:12:08,825 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-18 23:12:08,832 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-18 23:12:08,833 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-18 23:12:08,833 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-18 23:12:08,833 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689721913599.100ddfebe3307ec17b7b04df7f527464.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689721928833"}]},"ts":"9223372036854775807"} 2023-07-18 23:12:08,834 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689721913599.22548ea393e8d556ca6ac256fce8000e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689721928833"}]},"ts":"9223372036854775807"} 2023-07-18 23:12:08,835 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-18 23:12:08,835 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 100ddfebe3307ec17b7b04df7f527464, NAME => 'testtb-testEmptyExportFileSystemState,,1689721913599.100ddfebe3307ec17b7b04df7f527464.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 22548ea393e8d556ca6ac256fce8000e, NAME => 'testtb-testEmptyExportFileSystemState,1,1689721913599.22548ea393e8d556ca6ac256fce8000e.', STARTKEY => '1', ENDKEY => ''}] 2023-07-18 23:12:08,835 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-18 23:12:08,835 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689721928835"}]},"ts":"9223372036854775807"} 2023-07-18 23:12:08,837 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-18 23:12:08,839 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-18 23:12:08,840 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 45 msec 2023-07-18 23:12:08,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-18 23:12:08,908 INFO [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-18 23:12:08,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-18 23:12:08,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 23:12:08,917 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-18 23:12:08,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-18 23:12:08,952 INFO [Listener at jenkins-hbase4.apache.org/33217] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=762 (was 762), OpenFileDescriptor=900 (was 910), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=694 (was 586) - SystemLoadAverage LEAK? -, ProcessCount=187 (was 188), AvailableMemoryMB=1122 (was 2055) 2023-07-18 23:12:08,953 WARN [Listener at jenkins-hbase4.apache.org/33217] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-18 23:12:08,976 INFO [Listener at jenkins-hbase4.apache.org/33217] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=762, OpenFileDescriptor=900, MaxFileDescriptor=60000, SystemLoadAverage=694, ProcessCount=187, AvailableMemoryMB=1122 2023-07-18 23:12:08,976 WARN [Listener at jenkins-hbase4.apache.org/33217] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-18 23:12:08,978 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-18 23:12:08,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:08,982 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 23:12:08,982 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-18 23:12:08,983 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 23:12:08,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-18 23:12:08,986 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/05fec34d88a1d3d3ae86b5da6d10d63a 2023-07-18 23:12:08,986 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/88b8cbd315b2b5268160f3b51313f7d3 2023-07-18 23:12:08,987 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/05fec34d88a1d3d3ae86b5da6d10d63a empty. 2023-07-18 23:12:08,987 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/88b8cbd315b2b5268160f3b51313f7d3 empty. 2023-07-18 23:12:08,987 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/05fec34d88a1d3d3ae86b5da6d10d63a 2023-07-18 23:12:08,987 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/88b8cbd315b2b5268160f3b51313f7d3 2023-07-18 23:12:08,988 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-18 23:12:09,012 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-18 23:12:09,014 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 88b8cbd315b2b5268160f3b51313f7d3, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689721928977.88b8cbd315b2b5268160f3b51313f7d3.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp 2023-07-18 23:12:09,014 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 05fec34d88a1d3d3ae86b5da6d10d63a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689721928977.05fec34d88a1d3d3ae86b5da6d10d63a.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp 2023-07-18 23:12:09,048 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689721928977.05fec34d88a1d3d3ae86b5da6d10d63a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 23:12:09,048 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 05fec34d88a1d3d3ae86b5da6d10d63a, disabling compactions & flushes 2023-07-18 23:12:09,049 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689721928977.05fec34d88a1d3d3ae86b5da6d10d63a. 2023-07-18 23:12:09,049 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689721928977.05fec34d88a1d3d3ae86b5da6d10d63a. 2023-07-18 23:12:09,049 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689721928977.05fec34d88a1d3d3ae86b5da6d10d63a. after waiting 0 ms 2023-07-18 23:12:09,049 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689721928977.05fec34d88a1d3d3ae86b5da6d10d63a. 2023-07-18 23:12:09,049 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689721928977.05fec34d88a1d3d3ae86b5da6d10d63a. 2023-07-18 23:12:09,049 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 05fec34d88a1d3d3ae86b5da6d10d63a: 2023-07-18 23:12:09,049 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689721928977.88b8cbd315b2b5268160f3b51313f7d3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 23:12:09,049 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 88b8cbd315b2b5268160f3b51313f7d3, disabling compactions & flushes 2023-07-18 23:12:09,049 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689721928977.88b8cbd315b2b5268160f3b51313f7d3. 2023-07-18 23:12:09,049 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689721928977.88b8cbd315b2b5268160f3b51313f7d3. 2023-07-18 23:12:09,049 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689721928977.88b8cbd315b2b5268160f3b51313f7d3. after waiting 0 ms 2023-07-18 23:12:09,049 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689721928977.88b8cbd315b2b5268160f3b51313f7d3. 2023-07-18 23:12:09,049 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689721928977.88b8cbd315b2b5268160f3b51313f7d3. 2023-07-18 23:12:09,049 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 88b8cbd315b2b5268160f3b51313f7d3: 2023-07-18 23:12:09,052 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 23:12:09,053 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689721928977.05fec34d88a1d3d3ae86b5da6d10d63a.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689721929053"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689721929053"}]},"ts":"1689721929053"} 2023-07-18 23:12:09,053 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689721928977.88b8cbd315b2b5268160f3b51313f7d3.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689721929053"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689721929053"}]},"ts":"1689721929053"} 2023-07-18 23:12:09,055 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-18 23:12:09,056 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 23:12:09,056 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689721929056"}]},"ts":"1689721929056"} 2023-07-18 23:12:09,057 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-18 23:12:09,061 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 23:12:09,062 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 23:12:09,062 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 23:12:09,062 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 23:12:09,062 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 23:12:09,062 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=05fec34d88a1d3d3ae86b5da6d10d63a, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=88b8cbd315b2b5268160f3b51313f7d3, ASSIGN}] 2023-07-18 23:12:09,064 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=05fec34d88a1d3d3ae86b5da6d10d63a, ASSIGN 2023-07-18 23:12:09,064 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=88b8cbd315b2b5268160f3b51313f7d3, ASSIGN 2023-07-18 23:12:09,065 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=88b8cbd315b2b5268160f3b51313f7d3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38625,1689721809654; forceNewPlan=false, retain=false 2023-07-18 23:12:09,065 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=05fec34d88a1d3d3ae86b5da6d10d63a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45431,1689721809599; forceNewPlan=false, retain=false 2023-07-18 23:12:09,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-18 23:12:09,215 INFO [jenkins-hbase4:46651] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-18 23:12:09,218 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=88b8cbd315b2b5268160f3b51313f7d3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:12:09,218 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=05fec34d88a1d3d3ae86b5da6d10d63a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:12:09,218 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689721928977.88b8cbd315b2b5268160f3b51313f7d3.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689721929218"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689721929218"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689721929218"}]},"ts":"1689721929218"} 2023-07-18 23:12:09,218 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689721928977.05fec34d88a1d3d3ae86b5da6d10d63a.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689721929218"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689721929218"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689721929218"}]},"ts":"1689721929218"} 2023-07-18 23:12:09,220 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure 88b8cbd315b2b5268160f3b51313f7d3, server=jenkins-hbase4.apache.org,38625,1689721809654}] 2023-07-18 23:12:09,221 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 05fec34d88a1d3d3ae86b5da6d10d63a, server=jenkins-hbase4.apache.org,45431,1689721809599}] 2023-07-18 23:12:09,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-18 23:12:09,376 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689721928977.05fec34d88a1d3d3ae86b5da6d10d63a. 2023-07-18 23:12:09,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 05fec34d88a1d3d3ae86b5da6d10d63a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689721928977.05fec34d88a1d3d3ae86b5da6d10d63a.', STARTKEY => '', ENDKEY => '1'} 2023-07-18 23:12:09,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689721928977.05fec34d88a1d3d3ae86b5da6d10d63a. service=AccessControlService 2023-07-18 23:12:09,377 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 23:12:09,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 05fec34d88a1d3d3ae86b5da6d10d63a 2023-07-18 23:12:09,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689721928977.05fec34d88a1d3d3ae86b5da6d10d63a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 23:12:09,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 05fec34d88a1d3d3ae86b5da6d10d63a 2023-07-18 23:12:09,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 05fec34d88a1d3d3ae86b5da6d10d63a 2023-07-18 23:12:09,385 INFO [StoreOpener-05fec34d88a1d3d3ae86b5da6d10d63a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 05fec34d88a1d3d3ae86b5da6d10d63a 2023-07-18 23:12:09,388 DEBUG [StoreOpener-05fec34d88a1d3d3ae86b5da6d10d63a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithSkipTmp/05fec34d88a1d3d3ae86b5da6d10d63a/cf 2023-07-18 23:12:09,388 DEBUG [StoreOpener-05fec34d88a1d3d3ae86b5da6d10d63a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithSkipTmp/05fec34d88a1d3d3ae86b5da6d10d63a/cf 2023-07-18 23:12:09,389 INFO [StoreOpener-05fec34d88a1d3d3ae86b5da6d10d63a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 05fec34d88a1d3d3ae86b5da6d10d63a columnFamilyName cf 2023-07-18 23:12:09,389 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689721928977.88b8cbd315b2b5268160f3b51313f7d3. 2023-07-18 23:12:09,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 88b8cbd315b2b5268160f3b51313f7d3, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689721928977.88b8cbd315b2b5268160f3b51313f7d3.', STARTKEY => '1', ENDKEY => ''} 2023-07-18 23:12:09,389 INFO [StoreOpener-05fec34d88a1d3d3ae86b5da6d10d63a-1] regionserver.HStore(310): Store=05fec34d88a1d3d3ae86b5da6d10d63a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 23:12:09,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689721928977.88b8cbd315b2b5268160f3b51313f7d3. service=AccessControlService 2023-07-18 23:12:09,390 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 23:12:09,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 88b8cbd315b2b5268160f3b51313f7d3 2023-07-18 23:12:09,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689721928977.88b8cbd315b2b5268160f3b51313f7d3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 23:12:09,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 88b8cbd315b2b5268160f3b51313f7d3 2023-07-18 23:12:09,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 88b8cbd315b2b5268160f3b51313f7d3 2023-07-18 23:12:09,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithSkipTmp/05fec34d88a1d3d3ae86b5da6d10d63a 2023-07-18 23:12:09,391 INFO [StoreOpener-88b8cbd315b2b5268160f3b51313f7d3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 88b8cbd315b2b5268160f3b51313f7d3 2023-07-18 23:12:09,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithSkipTmp/05fec34d88a1d3d3ae86b5da6d10d63a 2023-07-18 23:12:09,393 DEBUG [StoreOpener-88b8cbd315b2b5268160f3b51313f7d3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithSkipTmp/88b8cbd315b2b5268160f3b51313f7d3/cf 2023-07-18 23:12:09,393 DEBUG [StoreOpener-88b8cbd315b2b5268160f3b51313f7d3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithSkipTmp/88b8cbd315b2b5268160f3b51313f7d3/cf 2023-07-18 23:12:09,393 INFO [StoreOpener-88b8cbd315b2b5268160f3b51313f7d3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 88b8cbd315b2b5268160f3b51313f7d3 columnFamilyName cf 2023-07-18 23:12:09,394 INFO [StoreOpener-88b8cbd315b2b5268160f3b51313f7d3-1] regionserver.HStore(310): Store=88b8cbd315b2b5268160f3b51313f7d3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 23:12:09,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 05fec34d88a1d3d3ae86b5da6d10d63a 2023-07-18 23:12:09,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithSkipTmp/88b8cbd315b2b5268160f3b51313f7d3 2023-07-18 23:12:09,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithSkipTmp/88b8cbd315b2b5268160f3b51313f7d3 2023-07-18 23:12:09,399 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 88b8cbd315b2b5268160f3b51313f7d3 2023-07-18 23:12:09,400 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithSkipTmp/05fec34d88a1d3d3ae86b5da6d10d63a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 23:12:09,401 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 05fec34d88a1d3d3ae86b5da6d10d63a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62593519, jitterRate=-0.06728388369083405}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 23:12:09,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 05fec34d88a1d3d3ae86b5da6d10d63a: 2023-07-18 23:12:09,401 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689721928977.05fec34d88a1d3d3ae86b5da6d10d63a., pid=109, masterSystemTime=1689721929372 2023-07-18 23:12:09,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689721928977.05fec34d88a1d3d3ae86b5da6d10d63a. 2023-07-18 23:12:09,403 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689721928977.05fec34d88a1d3d3ae86b5da6d10d63a. 2023-07-18 23:12:09,404 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=05fec34d88a1d3d3ae86b5da6d10d63a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:12:09,404 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689721928977.05fec34d88a1d3d3ae86b5da6d10d63a.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689721929404"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689721929404"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689721929404"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689721929404"}]},"ts":"1689721929404"} 2023-07-18 23:12:09,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithSkipTmp/88b8cbd315b2b5268160f3b51313f7d3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 23:12:09,406 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 88b8cbd315b2b5268160f3b51313f7d3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60635645, jitterRate=-0.09645847976207733}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 23:12:09,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 88b8cbd315b2b5268160f3b51313f7d3: 2023-07-18 23:12:09,407 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689721928977.88b8cbd315b2b5268160f3b51313f7d3., pid=108, masterSystemTime=1689721929372 2023-07-18 23:12:09,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689721928977.88b8cbd315b2b5268160f3b51313f7d3. 2023-07-18 23:12:09,408 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689721928977.88b8cbd315b2b5268160f3b51313f7d3. 2023-07-18 23:12:09,410 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=88b8cbd315b2b5268160f3b51313f7d3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:12:09,410 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689721928977.88b8cbd315b2b5268160f3b51313f7d3.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689721929410"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689721929410"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689721929410"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689721929410"}]},"ts":"1689721929410"} 2023-07-18 23:12:09,411 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-18 23:12:09,411 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 05fec34d88a1d3d3ae86b5da6d10d63a, server=jenkins-hbase4.apache.org,45431,1689721809599 in 185 msec 2023-07-18 23:12:09,412 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=05fec34d88a1d3d3ae86b5da6d10d63a, ASSIGN in 349 msec 2023-07-18 23:12:09,414 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-18 23:12:09,414 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure 88b8cbd315b2b5268160f3b51313f7d3, server=jenkins-hbase4.apache.org,38625,1689721809654 in 192 msec 2023-07-18 23:12:09,421 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-07-18 23:12:09,421 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=88b8cbd315b2b5268160f3b51313f7d3, ASSIGN in 352 msec 2023-07-18 23:12:09,422 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 23:12:09,422 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689721929422"}]},"ts":"1689721929422"} 2023-07-18 23:12:09,424 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-18 23:12:09,426 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 23:12:09,426 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-18 23:12:09,428 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45387] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-18 23:12:09,430 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 23:12:09,430 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 23:12:09,430 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 23:12:09,430 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 23:12:09,432 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-18 23:12:09,432 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-18 23:12:09,433 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-18 23:12:09,433 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-18 23:12:09,434 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 455 msec 2023-07-18 23:12:09,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-18 23:12:09,590 INFO [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-18 23:12:09,590 DEBUG [Listener at jenkins-hbase4.apache.org/33217] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithSkipTmp get assigned. Timeout = 60000ms 2023-07-18 23:12:09,590 INFO [Listener at jenkins-hbase4.apache.org/33217] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 23:12:09,593 INFO [Listener at jenkins-hbase4.apache.org/33217] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned to meta. Checking AM states. 2023-07-18 23:12:09,594 INFO [Listener at jenkins-hbase4.apache.org/33217] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 23:12:09,594 INFO [Listener at jenkins-hbase4.apache.org/33217] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned. 2023-07-18 23:12:09,597 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-18 23:12:09,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689721929597 (current time:1689721929597). 2023-07-18 23:12:09,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 23:12:09,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(139): Connect 0x459e7b12 to 127.0.0.1:61306 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 23:12:09,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@50920a42, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 23:12:09,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 23:12:09,608 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44174, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 23:12:09,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x459e7b12 to 127.0.0.1:61306 2023-07-18 23:12:09,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 23:12:09,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(139): Connect 0x74bdc8f4 to 127.0.0.1:61306 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 23:12:09,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@42cd6b9a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 23:12:09,618 DEBUG [hconnection-0x2cdb99b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 23:12:09,622 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44190, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 23:12:09,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x74bdc8f4 to 127.0.0.1:61306 2023-07-18 23:12:09,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 23:12:09,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-18 23:12:09,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 23:12:09,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-18 23:12:09,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-18 23:12:09,633 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-18 23:12:09,634 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689722529634 2023-07-18 23:12:09,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-18 23:12:09,634 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,636 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 23:12:09,636 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 23:12:09,636 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-18 23:12:09,637 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-18 23:12:09,638 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 7 msec 2023-07-18 23:12:09,639 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-18 23:12:09,640 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689722529640 2023-07-18 23:12:09,654 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,654 INFO [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-18 23:12:09,654 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 23:12:09,656 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-18 23:12:09,656 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-18 23:12:09,657 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,657 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,658 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:12:09,658 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:12:09,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:12:09,658 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:12:09,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:12:09,658 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:12:09,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:12:09,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:12:09,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:12:09,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:12:09,659 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:12:09,659 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:12:09,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,660 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:12:09,660 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 23:12:09,660 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,660 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,660 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-18 23:12:09,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-18 23:12:09,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,660 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-18 23:12:09,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-18 23:12:09,660 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-18 23:12:09,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,660 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,660 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-18 23:12:09,660 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 23:12:09,660 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-18 23:12:09,661 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-18 23:12:09,662 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-18 23:12:09,660 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,662 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,662 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-18 23:12:09,662 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45431,1689721809599' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-18 23:12:09,662 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 23:12:09,662 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-18 23:12:09,663 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-18 23:12:09,663 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-18 23:12:09,663 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 23:12:09,663 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38625,1689721809654' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-18 23:12:09,664 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-18 23:12:09,664 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-18 23:12:09,664 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45387,1689721809516' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-18 23:12:09,671 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,671 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,671 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:12:09,672 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:12:09,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:12:09,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:12:09,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:12:09,673 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,673 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,673 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 23:12:09,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:12:09,673 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 23:12:09,673 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:12:09,673 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,673 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 23:12:09,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:12:09,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:12:09,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:12:09,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:12:09,675 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45431,1689721809599' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-18 23:12:09,675 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5bb97761[Count = 1] remaining members to acquire global barrier 2023-07-18 23:12:09,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:12:09,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:12:09,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:12:09,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:12:09,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:12:09,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:12:09,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:12:09,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:12:09,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:12:09,678 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38625,1689721809654' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-18 23:12:09,678 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5bb97761[Count = 0] remaining members to acquire global barrier 2023-07-18 23:12:09,678 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-18 23:12:09,678 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,680 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,680 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,680 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,680 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-18 23:12:09,680 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-18 23:12:09,680 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45387,1689721809516' in zk 2023-07-18 23:12:09,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,681 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-18 23:12:09,681 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 23:12:09,681 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 23:12:09,681 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689721928977.88b8cbd315b2b5268160f3b51313f7d3. 2023-07-18 23:12:09,681 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689721928977.88b8cbd315b2b5268160f3b51313f7d3. started... 2023-07-18 23:12:09,684 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 88b8cbd315b2b5268160f3b51313f7d3: 2023-07-18 23:12:09,684 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-18 23:12:09,684 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689721928977.88b8cbd315b2b5268160f3b51313f7d3.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,684 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 23:12:09,684 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 23:12:09,684 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 23:12:09,684 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 23:12:09,685 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689721928977.05fec34d88a1d3d3ae86b5da6d10d63a. 2023-07-18 23:12:09,685 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689721928977.05fec34d88a1d3d3ae86b5da6d10d63a. started... 2023-07-18 23:12:09,686 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 05fec34d88a1d3d3ae86b5da6d10d63a: 2023-07-18 23:12:09,686 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689721928977.05fec34d88a1d3d3ae86b5da6d10d63a.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,686 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 23:12:09,686 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 23:12:09,690 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-18 23:12:09,691 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 23:12:09,691 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-18 23:12:09,696 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:12:09,696 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:12:09,696 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 23:12:09,721 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689721928977.05fec34d88a1d3d3ae86b5da6d10d63a. completed. 2023-07-18 23:12:09,721 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689721928977.05fec34d88a1d3d3ae86b5da6d10d63a. 2023-07-18 23:12:09,721 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 23:12:09,721 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 23:12:09,721 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:12:09,721 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-18 23:12:09,721 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45431,1689721809599' in zk 2023-07-18 23:12:09,724 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-18 23:12:09,724 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:12:09,724 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 23:12:09,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:12:09,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:12:09,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:12:09,724 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-18 23:12:09,726 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689721928977.88b8cbd315b2b5268160f3b51313f7d3. completed. 2023-07-18 23:12:09,726 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689721928977.88b8cbd315b2b5268160f3b51313f7d3. 2023-07-18 23:12:09,726 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 23:12:09,726 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 23:12:09,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:12:09,726 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:12:09,726 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-18 23:12:09,726 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,38625,1689721809654' in zk 2023-07-18 23:12:09,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:12:09,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,728 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:12:09,728 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-18 23:12:09,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:12:09,728 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 23:12:09,728 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-18 23:12:09,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:12:09,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:12:09,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:12:09,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:12:09,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:12:09,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:12:09,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,45431,1689721809599': 2023-07-18 23:12:09,733 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45431,1689721809599' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-18 23:12:09,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:12:09,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:12:09,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:12:09,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:12:09,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:12:09,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:12:09,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:12:09,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:12:09,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:12:09,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,736 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 23:12:09,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:12:09,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:12:09,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-18 23:12:09,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-18 23:12:09,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:12:09,737 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 23:12:09,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,38625,1689721809654': 2023-07-18 23:12:09,738 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38625,1689721809654' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-18 23:12:09,738 INFO [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-18 23:12:09,738 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 23:12:09,738 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 23:12:09,738 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,738 INFO [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 23:12:09,740 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,740 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,740 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,740 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:12:09,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,740 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:12:09,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:12:09,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,740 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:12:09,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:12:09,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:12:09,740 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:12:09,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:12:09,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:12:09,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:12:09,746 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:12:09,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,746 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:12:09,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:12:09,747 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:12:09,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:12:09,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:12:09,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:12:09,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:12:09,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,750 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:12:09,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:12:09,750 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:12:09,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:12:09,750 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:12:09,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:12:09,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:12:09,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:12:09,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,757 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:12:09,757 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:12:09,757 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:12:09,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:12:09,757 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:12:09,757 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,757 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:12:09,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:12:09,757 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 23:12:09,757 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:12:09,757 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:12:09,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:12:09,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:12:09,757 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:12:09,757 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:12:09,759 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:12:09,759 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:12:09,759 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,759 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:12:09,759 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,759 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:12:09,759 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:12:09,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:12:09,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:12:09,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:12:09,760 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,759 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:12:09,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:12:09,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:12:09,760 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,825 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,923 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-18 23:12:09,923 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,923 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,923 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689721929634Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689721929757 (+123 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689721929757Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689721929766 (+9 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689721929816 (+50 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689721929923 (+107 ms) 2023-07-18 23:12:09,927 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-18 23:12:09,928 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 292 msec 2023-07-18 23:12:09,937 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 23:12:09,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-18 23:12:09,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 23:12:09,964 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45431] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689721928977.05fec34d88a1d3d3ae86b5da6d10d63a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 23:12:09,981 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38625] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689721928977.88b8cbd315b2b5268160f3b51313f7d3. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 23:12:09,988 DEBUG [Listener at jenkins-hbase4.apache.org/33217] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:09,989 DEBUG [Listener at jenkins-hbase4.apache.org/33217] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689721928977.05fec34d88a1d3d3ae86b5da6d10d63a. 2023-07-18 23:12:09,989 INFO [Listener at jenkins-hbase4.apache.org/33217] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 23:12:10,002 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-18 23:12:10,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689721930002 (current time:1689721930002). 2023-07-18 23:12:10,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 23:12:10,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(139): Connect 0x596e607f to 127.0.0.1:61306 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 23:12:10,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@36801ba8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 23:12:10,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 23:12:10,025 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44192, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 23:12:10,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x596e607f to 127.0.0.1:61306 2023-07-18 23:12:10,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 23:12:10,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(139): Connect 0x2880512b to 127.0.0.1:61306 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 23:12:10,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@247b1dc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 23:12:10,133 DEBUG [hconnection-0x342cb767-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 23:12:10,135 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44208, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 23:12:10,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2880512b to 127.0.0.1:61306 2023-07-18 23:12:10,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 23:12:10,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-18 23:12:10,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 23:12:10,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-18 23:12:10,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-18 23:12:10,147 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-18 23:12:10,148 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689722530148 2023-07-18 23:12:10,148 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-18 23:12:10,150 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 23:12:10,150 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 23:12:10,152 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-18 23:12:10,154 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-18 23:12:10,154 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 7 msec 2023-07-18 23:12:10,156 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-18 23:12:10,156 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689722530156 2023-07-18 23:12:10,176 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,176 INFO [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-18 23:12:10,176 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 23:12:10,178 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-18 23:12:10,178 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-18 23:12:10,178 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,178 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,180 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:12:10,180 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:12:10,180 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:12:10,180 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:12:10,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:12:10,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:12:10,180 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:12:10,180 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:12:10,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,181 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:12:10,181 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:12:10,181 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,181 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,181 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:12:10,181 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 23:12:10,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-18 23:12:10,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-18 23:12:10,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,182 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-18 23:12:10,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,182 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-18 23:12:10,182 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:12:10,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:12:10,183 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-18 23:12:10,183 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 23:12:10,183 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,184 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-18 23:12:10,184 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-18 23:12:10,184 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 23:12:10,184 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-18 23:12:10,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,186 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-18 23:12:10,186 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-18 23:12:10,186 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45431,1689721809599' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-18 23:12:10,186 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38625,1689721809654' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-18 23:12:10,186 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-18 23:12:10,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,187 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-18 23:12:10,187 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,187 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-18 23:12:10,187 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 23:12:10,188 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-18 23:12:10,188 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-18 23:12:10,188 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45387,1689721809516' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-18 23:12:10,189 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:12:10,189 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:12:10,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:12:10,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:12:10,189 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,189 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 23:12:10,189 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:12:10,189 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:12:10,191 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:12:10,191 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,192 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 23:12:10,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,192 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,192 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 23:12:10,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:12:10,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:12:10,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:12:10,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:12:10,194 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45431,1689721809599' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-18 23:12:10,194 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9bd3a92[Count = 1] remaining members to acquire global barrier 2023-07-18 23:12:10,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:12:10,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:12:10,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:12:10,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:12:10,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:12:10,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:12:10,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:12:10,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:12:10,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:12:10,197 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38625,1689721809654' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-18 23:12:10,197 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9bd3a92[Count = 0] remaining members to acquire global barrier 2023-07-18 23:12:10,197 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-18 23:12:10,197 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,202 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,202 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,202 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,202 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:12:10,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,202 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-18 23:12:10,202 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-18 23:12:10,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,202 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-18 23:12:10,202 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-18 23:12:10,203 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 23:12:10,203 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 23:12:10,203 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689721928977.88b8cbd315b2b5268160f3b51313f7d3. 2023-07-18 23:12:10,203 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689721928977.05fec34d88a1d3d3ae86b5da6d10d63a. 2023-07-18 23:12:10,202 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 23:12:10,203 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689721928977.05fec34d88a1d3d3ae86b5da6d10d63a. started... 2023-07-18 23:12:10,203 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689721928977.88b8cbd315b2b5268160f3b51313f7d3. started... 2023-07-18 23:12:10,203 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:12:10,203 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 23:12:10,203 INFO [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 05fec34d88a1d3d3ae86b5da6d10d63a 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-18 23:12:10,203 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45387,1689721809516' in zk 2023-07-18 23:12:10,203 INFO [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 88b8cbd315b2b5268160f3b51313f7d3 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-18 23:12:10,203 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 23:12:10,206 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-18 23:12:10,206 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 23:12:10,206 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689721809516' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-18 23:12:10,249 INFO [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithSkipTmp/05fec34d88a1d3d3ae86b5da6d10d63a/.tmp/cf/7ddbccd0ea314019839d8fed65dc8ae8 2023-07-18 23:12:10,250 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 23:12:10,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-18 23:12:10,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-18 23:12:10,251 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 23:12:10,255 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithSkipTmp/05fec34d88a1d3d3ae86b5da6d10d63a/.tmp/cf/7ddbccd0ea314019839d8fed65dc8ae8 as hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithSkipTmp/05fec34d88a1d3d3ae86b5da6d10d63a/cf/7ddbccd0ea314019839d8fed65dc8ae8 2023-07-18 23:12:10,261 INFO [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithSkipTmp/05fec34d88a1d3d3ae86b5da6d10d63a/cf/7ddbccd0ea314019839d8fed65dc8ae8, entries=3, sequenceid=6, filesize=5.0 K 2023-07-18 23:12:10,262 INFO [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 05fec34d88a1d3d3ae86b5da6d10d63a in 59ms, sequenceid=6, compaction requested=false 2023-07-18 23:12:10,262 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-18 23:12:10,263 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 05fec34d88a1d3d3ae86b5da6d10d63a: 2023-07-18 23:12:10,263 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689721928977.05fec34d88a1d3d3ae86b5da6d10d63a.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,263 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 23:12:10,263 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithSkipTmp/05fec34d88a1d3d3ae86b5da6d10d63a/cf/7ddbccd0ea314019839d8fed65dc8ae8] hfiles 2023-07-18 23:12:10,263 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithSkipTmp/05fec34d88a1d3d3ae86b5da6d10d63a/cf/7ddbccd0ea314019839d8fed65dc8ae8 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,267 INFO [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithSkipTmp/88b8cbd315b2b5268160f3b51313f7d3/.tmp/cf/203776050de546f3a6857aadebbaaaa0 2023-07-18 23:12:10,273 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithSkipTmp/88b8cbd315b2b5268160f3b51313f7d3/.tmp/cf/203776050de546f3a6857aadebbaaaa0 as hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithSkipTmp/88b8cbd315b2b5268160f3b51313f7d3/cf/203776050de546f3a6857aadebbaaaa0 2023-07-18 23:12:10,273 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689721928977.05fec34d88a1d3d3ae86b5da6d10d63a. completed. 2023-07-18 23:12:10,273 DEBUG [rs(jenkins-hbase4.apache.org,45431,1689721809599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689721928977.05fec34d88a1d3d3ae86b5da6d10d63a. 2023-07-18 23:12:10,273 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 23:12:10,273 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 23:12:10,273 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:12:10,273 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-18 23:12:10,273 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45431,1689721809599' in zk 2023-07-18 23:12:10,279 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:12:10,279 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-18 23:12:10,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:12:10,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:12:10,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:12:10,279 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 23:12:10,279 DEBUG [member: 'jenkins-hbase4.apache.org,45431,1689721809599' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-18 23:12:10,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:12:10,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:12:10,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,285 INFO [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithSkipTmp/88b8cbd315b2b5268160f3b51313f7d3/cf/203776050de546f3a6857aadebbaaaa0, entries=47, sequenceid=6, filesize=8.0 K 2023-07-18 23:12:10,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:12:10,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:12:10,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:12:10,287 INFO [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 88b8cbd315b2b5268160f3b51313f7d3 in 84ms, sequenceid=6, compaction requested=false 2023-07-18 23:12:10,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:12:10,289 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 88b8cbd315b2b5268160f3b51313f7d3: 2023-07-18 23:12:10,289 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689721928977.88b8cbd315b2b5268160f3b51313f7d3.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,289 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 23:12:10,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,290 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithSkipTmp/88b8cbd315b2b5268160f3b51313f7d3/cf/203776050de546f3a6857aadebbaaaa0] hfiles 2023-07-18 23:12:10,290 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithSkipTmp/88b8cbd315b2b5268160f3b51313f7d3/cf/203776050de546f3a6857aadebbaaaa0 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:12:10,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:12:10,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,45431,1689721809599': 2023-07-18 23:12:10,292 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45431,1689721809599' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-18 23:12:10,339 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689721928977.88b8cbd315b2b5268160f3b51313f7d3. completed. 2023-07-18 23:12:10,339 DEBUG [rs(jenkins-hbase4.apache.org,38625,1689721809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689721928977.88b8cbd315b2b5268160f3b51313f7d3. 2023-07-18 23:12:10,339 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 23:12:10,339 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 23:12:10,339 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:12:10,339 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-18 23:12:10,339 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,38625,1689721809654' in zk 2023-07-18 23:12:10,341 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:12:10,341 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-18 23:12:10,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:12:10,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:12:10,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:12:10,341 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 23:12:10,341 DEBUG [member: 'jenkins-hbase4.apache.org,38625,1689721809654' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-18 23:12:10,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:12:10,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:12:10,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:12:10,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:12:10,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:12:10,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:12:10,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:12:10,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:12:10,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:12:10,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,38625,1689721809654': 2023-07-18 23:12:10,360 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38625,1689721809654' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-18 23:12:10,360 INFO [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-18 23:12:10,360 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 23:12:10,360 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 23:12:10,360 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,360 INFO [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 23:12:10,362 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,362 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 23:12:10,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 23:12:10,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,362 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,362 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:12:10,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,363 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:12:10,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 23:12:10,363 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,363 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:12:10,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:12:10,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:12:10,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:12:10,363 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:12:10,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:12:10,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:12:10,364 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:12:10,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:12:10,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 23:12:10,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,364 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:12:10,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:12:10,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:12:10,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:12:10,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 23:12:10,367 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:12:10,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,368 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:12:10,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:12:10,368 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:12:10,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:12:10,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:12:10,372 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:12:10,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:12:10,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:12:10,372 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:12:10,372 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:12:10,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:12:10,372 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:12:10,372 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,373 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:12:10,373 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:12:10,373 DEBUG [(jenkins-hbase4.apache.org,46651,1689721807857)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 23:12:10,373 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:12:10,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:12:10,373 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,373 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,375 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:12:10,375 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,375 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:12:10,375 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:12:10,375 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,375 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,375 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:12:10,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:12:10,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:12:10,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:12:10,376 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,378 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 23:12:10,378 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 23:12:10,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 23:12:10,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 23:12:10,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 23:12:10,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 23:12:10,399 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,451 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 23:12:10,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-18 23:12:10,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-18 23:12:10,453 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-18 23:12:10,753 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 23:12:10,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-18 23:12:10,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-18 23:12:10,754 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-18 23:12:10,837 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-18 23:12:10,837 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,838 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:10,838 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689721930148Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689721930375 (+227 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689721930375Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689721930380 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689721930391 (+11 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689721930837 (+446 ms) 2023-07-18 23:12:10,841 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-18 23:12:10,842 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 691 msec 2023-07-18 23:12:11,254 DEBUG [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 23:12:11,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-18 23:12:11,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 23:12:11,256 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/export-test/export-1689721931256 2023-07-18 23:12:11,256 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45655, tgtDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/export-test/export-1689721931256, rawTgtDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/export-test/export-1689721931256, srcFsUri=hdfs://localhost:45655, srcDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054 2023-07-18 23:12:11,278 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45655, inputRoot=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054 2023-07-18 23:12:11,278 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_404950031_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/export-test/export-1689721931256, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/export-test/export-1689721931256/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:11,278 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45655, inputRoot=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054, snapshotDir=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-18 23:12:11,290 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/export-test/export-1689721931256/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:11,316 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-18 23:12:11,317 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-18 23:12:11,317 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-18 23:12:11,317 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-18 23:12:12,386 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/hadoop-1538925371320794224.jar 2023-07-18 23:12:12,387 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-18 23:12:12,387 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-18 23:12:12,468 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/hadoop-766712823161364834.jar 2023-07-18 23:12:12,468 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-18 23:12:12,469 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-18 23:12:12,469 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-18 23:12:12,470 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-18 23:12:12,470 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-18 23:12:12,470 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-18 23:12:12,471 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-18 23:12:12,471 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-18 23:12:12,472 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-18 23:12:12,472 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-18 23:12:12,473 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-18 23:12:12,473 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-18 23:12:12,474 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-18 23:12:12,474 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-18 23:12:12,474 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-18 23:12:12,475 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-18 23:12:12,476 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 23:12:12,476 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 23:12:12,477 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 23:12:12,477 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 23:12:12,477 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 23:12:12,478 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 23:12:12,478 DEBUG [Listener at jenkins-hbase4.apache.org/33217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 23:12:12,738 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689721818645_0006_000001 (auth:SIMPLE) 2023-07-18 23:12:12,995 WARN [Listener at jenkins-hbase4.apache.org/33217] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-18 23:12:12,997 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-18 23:12:12,999 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-18 23:12:13,089 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 23:12:13,089 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 23:12:13,761 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689721818645_0007_000001 (auth:SIMPLE) 2023-07-18 23:12:14,284 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 23:12:19,890 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689721818645_0007_000001 (auth:SIMPLE) 2023-07-18 23:12:22,296 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689721818645_0007_000001 (auth:SIMPLE) 2023-07-18 23:12:26,613 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689721818645_0007_000001 (auth:SIMPLE) 2023-07-18 23:12:28,336 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-18 23:12:28,336 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-18 23:12:28,347 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:28,347 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-18 23:12:28,348 INFO [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-18 23:12:28,348 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-702194233_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:28,348 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(367): hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-18 23:12:28,349 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(367): hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-18 23:12:28,349 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-702194233_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/export-test/export-1689721931256/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/export-test/export-1689721931256/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:28,349 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(367): hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/export-test/export-1689721931256/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-18 23:12:28,349 DEBUG [Listener at jenkins-hbase4.apache.org/33217] snapshot.TestExportSnapshot(367): hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/export-test/export-1689721931256/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-18 23:12:28,357 INFO [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:28,357 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:28,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:28,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-18 23:12:28,362 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689721948362"}]},"ts":"1689721948362"} 2023-07-18 23:12:28,364 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-18 23:12:28,365 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-18 23:12:28,366 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=05fec34d88a1d3d3ae86b5da6d10d63a, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=88b8cbd315b2b5268160f3b51313f7d3, UNASSIGN}] 2023-07-18 23:12:28,368 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=05fec34d88a1d3d3ae86b5da6d10d63a, UNASSIGN 2023-07-18 23:12:28,368 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=88b8cbd315b2b5268160f3b51313f7d3, UNASSIGN 2023-07-18 23:12:28,369 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=05fec34d88a1d3d3ae86b5da6d10d63a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:12:28,369 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=88b8cbd315b2b5268160f3b51313f7d3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:12:28,369 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689721928977.05fec34d88a1d3d3ae86b5da6d10d63a.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689721948369"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689721948369"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689721948369"}]},"ts":"1689721948369"} 2023-07-18 23:12:28,369 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689721928977.88b8cbd315b2b5268160f3b51313f7d3.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689721948369"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689721948369"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689721948369"}]},"ts":"1689721948369"} 2023-07-18 23:12:28,370 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 05fec34d88a1d3d3ae86b5da6d10d63a, server=jenkins-hbase4.apache.org,45431,1689721809599}] 2023-07-18 23:12:28,371 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 88b8cbd315b2b5268160f3b51313f7d3, server=jenkins-hbase4.apache.org,38625,1689721809654}] 2023-07-18 23:12:28,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-18 23:12:28,522 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 05fec34d88a1d3d3ae86b5da6d10d63a 2023-07-18 23:12:28,523 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 88b8cbd315b2b5268160f3b51313f7d3 2023-07-18 23:12:28,523 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 05fec34d88a1d3d3ae86b5da6d10d63a, disabling compactions & flushes 2023-07-18 23:12:28,523 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689721928977.05fec34d88a1d3d3ae86b5da6d10d63a. 2023-07-18 23:12:28,523 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689721928977.05fec34d88a1d3d3ae86b5da6d10d63a. 2023-07-18 23:12:28,523 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689721928977.05fec34d88a1d3d3ae86b5da6d10d63a. after waiting 0 ms 2023-07-18 23:12:28,523 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 88b8cbd315b2b5268160f3b51313f7d3, disabling compactions & flushes 2023-07-18 23:12:28,523 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689721928977.05fec34d88a1d3d3ae86b5da6d10d63a. 2023-07-18 23:12:28,523 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689721928977.88b8cbd315b2b5268160f3b51313f7d3. 2023-07-18 23:12:28,523 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689721928977.88b8cbd315b2b5268160f3b51313f7d3. 2023-07-18 23:12:28,523 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689721928977.88b8cbd315b2b5268160f3b51313f7d3. after waiting 0 ms 2023-07-18 23:12:28,523 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689721928977.88b8cbd315b2b5268160f3b51313f7d3. 2023-07-18 23:12:28,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithSkipTmp/05fec34d88a1d3d3ae86b5da6d10d63a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 23:12:28,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/default/testtb-testExportFileSystemStateWithSkipTmp/88b8cbd315b2b5268160f3b51313f7d3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 23:12:28,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 23:12:28,555 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 23:12:28,556 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689721928977.05fec34d88a1d3d3ae86b5da6d10d63a. 2023-07-18 23:12:28,556 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689721928977.88b8cbd315b2b5268160f3b51313f7d3. 2023-07-18 23:12:28,556 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 05fec34d88a1d3d3ae86b5da6d10d63a: 2023-07-18 23:12:28,556 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 88b8cbd315b2b5268160f3b51313f7d3: 2023-07-18 23:12:28,557 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 05fec34d88a1d3d3ae86b5da6d10d63a 2023-07-18 23:12:28,560 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=05fec34d88a1d3d3ae86b5da6d10d63a, regionState=CLOSED 2023-07-18 23:12:28,560 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 88b8cbd315b2b5268160f3b51313f7d3 2023-07-18 23:12:28,560 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689721928977.05fec34d88a1d3d3ae86b5da6d10d63a.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689721948560"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689721948560"}]},"ts":"1689721948560"} 2023-07-18 23:12:28,561 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=88b8cbd315b2b5268160f3b51313f7d3, regionState=CLOSED 2023-07-18 23:12:28,561 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689721928977.88b8cbd315b2b5268160f3b51313f7d3.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689721948561"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689721948561"}]},"ts":"1689721948561"} 2023-07-18 23:12:28,564 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-18 23:12:28,564 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 05fec34d88a1d3d3ae86b5da6d10d63a, server=jenkins-hbase4.apache.org,45431,1689721809599 in 192 msec 2023-07-18 23:12:28,565 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-18 23:12:28,565 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 88b8cbd315b2b5268160f3b51313f7d3, server=jenkins-hbase4.apache.org,38625,1689721809654 in 192 msec 2023-07-18 23:12:28,566 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=05fec34d88a1d3d3ae86b5da6d10d63a, UNASSIGN in 198 msec 2023-07-18 23:12:28,567 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-18 23:12:28,567 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=88b8cbd315b2b5268160f3b51313f7d3, UNASSIGN in 199 msec 2023-07-18 23:12:28,567 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689721948567"}]},"ts":"1689721948567"} 2023-07-18 23:12:28,568 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-18 23:12:28,570 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-18 23:12:28,573 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 214 msec 2023-07-18 23:12:28,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-18 23:12:28,667 INFO [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-18 23:12:28,668 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:28,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:28,672 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:28,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:28,674 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:28,675 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45387] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:28,685 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/05fec34d88a1d3d3ae86b5da6d10d63a 2023-07-18 23:12:28,686 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:28,686 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:28,686 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:28,686 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:28,686 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-18 23:12:28,686 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-18 23:12:28,686 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-18 23:12:28,687 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-18 23:12:28,688 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:28,688 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:28,688 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:28,688 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 23:12:28,688 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 23:12:28,688 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:28,688 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 23:12:28,688 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 23:12:28,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-18 23:12:28,699 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/88b8cbd315b2b5268160f3b51313f7d3 2023-07-18 23:12:28,701 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/05fec34d88a1d3d3ae86b5da6d10d63a/cf, FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/05fec34d88a1d3d3ae86b5da6d10d63a/recovered.edits] 2023-07-18 23:12:28,707 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/88b8cbd315b2b5268160f3b51313f7d3/cf, FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/88b8cbd315b2b5268160f3b51313f7d3/recovered.edits] 2023-07-18 23:12:28,709 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/05fec34d88a1d3d3ae86b5da6d10d63a/cf/7ddbccd0ea314019839d8fed65dc8ae8 to hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/05fec34d88a1d3d3ae86b5da6d10d63a/cf/7ddbccd0ea314019839d8fed65dc8ae8 2023-07-18 23:12:28,713 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/88b8cbd315b2b5268160f3b51313f7d3/cf/203776050de546f3a6857aadebbaaaa0 to hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/88b8cbd315b2b5268160f3b51313f7d3/cf/203776050de546f3a6857aadebbaaaa0 2023-07-18 23:12:28,718 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/88b8cbd315b2b5268160f3b51313f7d3/recovered.edits/9.seqid to hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/88b8cbd315b2b5268160f3b51313f7d3/recovered.edits/9.seqid 2023-07-18 23:12:28,719 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/88b8cbd315b2b5268160f3b51313f7d3 2023-07-18 23:12:28,719 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/05fec34d88a1d3d3ae86b5da6d10d63a/recovered.edits/9.seqid to hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/05fec34d88a1d3d3ae86b5da6d10d63a/recovered.edits/9.seqid 2023-07-18 23:12:28,721 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/05fec34d88a1d3d3ae86b5da6d10d63a 2023-07-18 23:12:28,721 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-18 23:12:28,724 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:28,739 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-18 23:12:28,745 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-18 23:12:28,747 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:28,747 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-18 23:12:28,748 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689721928977.05fec34d88a1d3d3ae86b5da6d10d63a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689721948748"}]},"ts":"9223372036854775807"} 2023-07-18 23:12:28,748 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689721928977.88b8cbd315b2b5268160f3b51313f7d3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689721948748"}]},"ts":"9223372036854775807"} 2023-07-18 23:12:28,753 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-18 23:12:28,753 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 05fec34d88a1d3d3ae86b5da6d10d63a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689721928977.05fec34d88a1d3d3ae86b5da6d10d63a.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 88b8cbd315b2b5268160f3b51313f7d3, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689721928977.88b8cbd315b2b5268160f3b51313f7d3.', STARTKEY => '1', ENDKEY => ''}] 2023-07-18 23:12:28,753 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-18 23:12:28,753 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689721948753"}]},"ts":"9223372036854775807"} 2023-07-18 23:12:28,761 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-18 23:12:28,763 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:28,767 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 95 msec 2023-07-18 23:12:28,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-18 23:12:28,791 INFO [Listener at jenkins-hbase4.apache.org/33217] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-18 23:12:28,800 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-18 23:12:28,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:28,811 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-18 23:12:28,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 23:12:28,843 INFO [Listener at jenkins-hbase4.apache.org/33217] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=764 (was 762) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1908476861_1 at /127.0.0.1:38846 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x32c52efa-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-702194233_17 at /127.0.0.1:58104 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5209 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x32c52efa-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x32c52efa-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x32c52efa-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (337744187) connection to jenkins-hbase4.apache.org/172.31.14.131:38523 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-702194233_17 at /127.0.0.1:48398 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1908476861_1 at /127.0.0.1:58086 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=895 (was 900), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=693 (was 694), ProcessCount=187 (was 187), AvailableMemoryMB=955 (was 1122) 2023-07-18 23:12:28,844 WARN [Listener at jenkins-hbase4.apache.org/33217] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-18 23:12:28,844 INFO [Listener at jenkins-hbase4.apache.org/33217] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-18 23:12:28,859 INFO [Listener at jenkins-hbase4.apache.org/33217] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-18 23:12:32,711 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689721818645_0007_000001 (auth:SIMPLE) 2023-07-18 23:12:34,129 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 23:12:42,985 INFO [Listener at jenkins-hbase4.apache.org/33217] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-18 23:12:57,106 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-18 23:12:57,107 INFO [Listener at jenkins-hbase4.apache.org/33217] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-18 23:12:57,217 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-18 23:12:57,230 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-18 23:12:57,231 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-18 23:12:57,248 INFO [Listener at jenkins-hbase4.apache.org/33217] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-18 23:12:57,254 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-18 23:12:57,254 INFO [Listener at jenkins-hbase4.apache.org/33217] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-18 23:12:57,254 INFO [Listener at jenkins-hbase4.apache.org/33217] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-18 23:12:57,254 INFO [Listener at jenkins-hbase4.apache.org/33217] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-18 23:12:57,254 DEBUG [Listener at jenkins-hbase4.apache.org/33217] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3c45df17 to 127.0.0.1:61306 2023-07-18 23:12:57,254 DEBUG [Listener at jenkins-hbase4.apache.org/33217] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 23:12:57,254 DEBUG [Listener at jenkins-hbase4.apache.org/33217] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-18 23:12:57,255 DEBUG [Listener at jenkins-hbase4.apache.org/33217] util.JVMClusterUtil(257): Found active master hash=690030059, stopped=false 2023-07-18 23:12:57,255 DEBUG [Listener at jenkins-hbase4.apache.org/33217] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 23:12:57,255 DEBUG [Listener at jenkins-hbase4.apache.org/33217] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-18 23:12:57,255 INFO [Listener at jenkins-hbase4.apache.org/33217] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,46651,1689721807857 2023-07-18 23:12:57,257 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-18 23:12:57,257 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-18 23:12:57,257 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-18 23:12:57,257 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-18 23:12:57,257 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 23:12:57,257 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 23:12:57,258 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 23:12:57,258 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 23:12:57,258 INFO [Listener at jenkins-hbase4.apache.org/33217] procedure2.ProcedureExecutor(629): Stopping 2023-07-18 23:12:57,258 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 23:12:57,259 DEBUG [Listener at jenkins-hbase4.apache.org/33217] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7f0afdd0 to 127.0.0.1:61306 2023-07-18 23:12:57,259 DEBUG [Listener at jenkins-hbase4.apache.org/33217] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 23:12:57,259 INFO [Listener at jenkins-hbase4.apache.org/33217] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,45387,1689721809516' ***** 2023-07-18 23:12:57,259 DEBUG [Listener at jenkins-hbase4.apache.org/33217] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 23:12:57,259 INFO [Listener at jenkins-hbase4.apache.org/33217] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-18 23:12:57,260 INFO [RS:0;jenkins-hbase4:45387] regionserver.HeapMemoryManager(220): Stopping 2023-07-18 23:12:57,260 INFO [RS:0;jenkins-hbase4:45387] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-18 23:12:57,260 INFO [RS:0;jenkins-hbase4:45387] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-18 23:12:57,260 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-18 23:12:57,260 INFO [RS:0;jenkins-hbase4:45387] regionserver.HRegionServer(3305): Received CLOSE for 82c0ae918e241fa463d9d693b29481c7 2023-07-18 23:12:57,261 INFO [RS:0;jenkins-hbase4:45387] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:12:57,261 DEBUG [RS:0;jenkins-hbase4:45387] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4900bdef to 127.0.0.1:61306 2023-07-18 23:12:57,261 DEBUG [RS:0;jenkins-hbase4:45387] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 23:12:57,261 INFO [Listener at jenkins-hbase4.apache.org/33217] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,45431,1689721809599' ***** 2023-07-18 23:12:57,261 DEBUG [Listener at jenkins-hbase4.apache.org/33217] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 23:12:57,261 INFO [Listener at jenkins-hbase4.apache.org/33217] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-18 23:12:57,262 INFO [Listener at jenkins-hbase4.apache.org/33217] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,38625,1689721809654' ***** 2023-07-18 23:12:57,263 INFO [RS:1;jenkins-hbase4:45431] regionserver.HeapMemoryManager(220): Stopping 2023-07-18 23:12:57,263 INFO [RS:0;jenkins-hbase4:45387] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-18 23:12:57,264 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-18 23:12:57,263 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 82c0ae918e241fa463d9d693b29481c7, disabling compactions & flushes 2023-07-18 23:12:57,264 INFO [RS:0;jenkins-hbase4:45387] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-18 23:12:57,264 INFO [RS:1;jenkins-hbase4:45431] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-18 23:12:57,264 INFO [RS:0;jenkins-hbase4:45387] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-18 23:12:57,264 DEBUG [Listener at jenkins-hbase4.apache.org/33217] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 23:12:57,264 INFO [RS:0;jenkins-hbase4:45387] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-18 23:12:57,264 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689721813339.82c0ae918e241fa463d9d693b29481c7. 2023-07-18 23:12:57,264 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689721813339.82c0ae918e241fa463d9d693b29481c7. 2023-07-18 23:12:57,264 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689721813339.82c0ae918e241fa463d9d693b29481c7. after waiting 0 ms 2023-07-18 23:12:57,265 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689721813339.82c0ae918e241fa463d9d693b29481c7. 2023-07-18 23:12:57,265 INFO [RS:0;jenkins-hbase4:45387] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-18 23:12:57,265 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 82c0ae918e241fa463d9d693b29481c7 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-18 23:12:57,265 DEBUG [RS:0;jenkins-hbase4:45387] regionserver.HRegionServer(1478): Online Regions={82c0ae918e241fa463d9d693b29481c7=hbase:acl,,1689721813339.82c0ae918e241fa463d9d693b29481c7., 1588230740=hbase:meta,,1.1588230740} 2023-07-18 23:12:57,264 INFO [Listener at jenkins-hbase4.apache.org/33217] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-18 23:12:57,264 INFO [RS:1;jenkins-hbase4:45431] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-18 23:12:57,265 INFO [RS:1;jenkins-hbase4:45431] regionserver.HRegionServer(3305): Received CLOSE for 223a7e9433605c67093dc1c37dd2dbc5 2023-07-18 23:12:57,265 INFO [RS:1;jenkins-hbase4:45431] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:12:57,265 DEBUG [RS:1;jenkins-hbase4:45431] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x34d84d19 to 127.0.0.1:61306 2023-07-18 23:12:57,265 DEBUG [RS:1;jenkins-hbase4:45431] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 23:12:57,266 DEBUG [RS:0;jenkins-hbase4:45387] regionserver.HRegionServer(1504): Waiting on 1588230740, 82c0ae918e241fa463d9d693b29481c7 2023-07-18 23:12:57,266 INFO [RS:2;jenkins-hbase4:38625] regionserver.HeapMemoryManager(220): Stopping 2023-07-18 23:12:57,266 INFO [RS:2;jenkins-hbase4:38625] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-18 23:12:57,266 INFO [RS:2;jenkins-hbase4:38625] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-18 23:12:57,266 INFO [RS:2;jenkins-hbase4:38625] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:12:57,268 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-18 23:12:57,270 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-18 23:12:57,268 DEBUG [RS:2;jenkins-hbase4:38625] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x746b42ad to 127.0.0.1:61306 2023-07-18 23:12:57,268 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 223a7e9433605c67093dc1c37dd2dbc5, disabling compactions & flushes 2023-07-18 23:12:57,269 INFO [RS:1;jenkins-hbase4:45431] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-18 23:12:57,271 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689721812495.223a7e9433605c67093dc1c37dd2dbc5. 2023-07-18 23:12:57,271 DEBUG [RS:2;jenkins-hbase4:38625] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 23:12:57,271 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-18 23:12:57,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689721812495.223a7e9433605c67093dc1c37dd2dbc5. 2023-07-18 23:12:57,271 DEBUG [RS:1;jenkins-hbase4:45431] regionserver.HRegionServer(1478): Online Regions={223a7e9433605c67093dc1c37dd2dbc5=hbase:namespace,,1689721812495.223a7e9433605c67093dc1c37dd2dbc5.} 2023-07-18 23:12:57,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689721812495.223a7e9433605c67093dc1c37dd2dbc5. after waiting 0 ms 2023-07-18 23:12:57,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689721812495.223a7e9433605c67093dc1c37dd2dbc5. 2023-07-18 23:12:57,271 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-18 23:12:57,272 INFO [RS:2;jenkins-hbase4:38625] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,38625,1689721809654; all regions closed. 2023-07-18 23:12:57,271 DEBUG [RS:1;jenkins-hbase4:45431] regionserver.HRegionServer(1504): Waiting on 223a7e9433605c67093dc1c37dd2dbc5 2023-07-18 23:12:57,272 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-18 23:12:57,272 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-18 23:12:57,272 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-18 23:12:57,271 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 223a7e9433605c67093dc1c37dd2dbc5 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-18 23:12:57,320 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-18 23:12:57,324 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/hbase/acl/82c0ae918e241fa463d9d693b29481c7/.tmp/l/d55c3a6fca2848198434159bc722cdb7 2023-07-18 23:12:57,328 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-18 23:12:57,331 DEBUG [RS:2;jenkins-hbase4:38625] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/oldWALs 2023-07-18 23:12:57,331 INFO [RS:2;jenkins-hbase4:38625] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38625%2C1689721809654:(num 1689721811934) 2023-07-18 23:12:57,331 DEBUG [RS:2;jenkins-hbase4:38625] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 23:12:57,331 INFO [RS:2;jenkins-hbase4:38625] regionserver.LeaseManager(133): Closed leases 2023-07-18 23:12:57,332 INFO [RS:2;jenkins-hbase4:38625] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-18 23:12:57,332 INFO [RS:2;jenkins-hbase4:38625] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-18 23:12:57,332 INFO [RS:2;jenkins-hbase4:38625] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-18 23:12:57,332 INFO [RS:2;jenkins-hbase4:38625] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-18 23:12:57,333 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-18 23:12:57,333 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/hbase/namespace/223a7e9433605c67093dc1c37dd2dbc5/.tmp/info/99944561b9d442bd9a4121025bfdd8e8 2023-07-18 23:12:57,334 INFO [RS:2;jenkins-hbase4:38625] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38625 2023-07-18 23:12:57,335 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-18 23:12:57,335 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d55c3a6fca2848198434159bc722cdb7 2023-07-18 23:12:57,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/hbase/acl/82c0ae918e241fa463d9d693b29481c7/.tmp/l/d55c3a6fca2848198434159bc722cdb7 as hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/hbase/acl/82c0ae918e241fa463d9d693b29481c7/l/d55c3a6fca2848198434159bc722cdb7 2023-07-18 23:12:57,338 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/hbase/meta/1588230740/.tmp/info/7f5ebca77e564995b163e9f14445239b 2023-07-18 23:12:57,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/hbase/namespace/223a7e9433605c67093dc1c37dd2dbc5/.tmp/info/99944561b9d442bd9a4121025bfdd8e8 as hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/hbase/namespace/223a7e9433605c67093dc1c37dd2dbc5/info/99944561b9d442bd9a4121025bfdd8e8 2023-07-18 23:12:57,344 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7f5ebca77e564995b163e9f14445239b 2023-07-18 23:12:57,345 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d55c3a6fca2848198434159bc722cdb7 2023-07-18 23:12:57,345 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/hbase/acl/82c0ae918e241fa463d9d693b29481c7/l/d55c3a6fca2848198434159bc722cdb7, entries=7, sequenceid=18, filesize=5.2 K 2023-07-18 23:12:57,348 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/hbase/namespace/223a7e9433605c67093dc1c37dd2dbc5/info/99944561b9d442bd9a4121025bfdd8e8, entries=2, sequenceid=6, filesize=4.8 K 2023-07-18 23:12:57,349 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 82c0ae918e241fa463d9d693b29481c7 in 84ms, sequenceid=18, compaction requested=false 2023-07-18 23:12:57,350 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 223a7e9433605c67093dc1c37dd2dbc5 in 79ms, sequenceid=6, compaction requested=false 2023-07-18 23:12:57,363 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/hbase/meta/1588230740/.tmp/rep_barrier/3b47e40ac0314e3e8d0dcd100a992631 2023-07-18 23:12:57,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/hbase/acl/82c0ae918e241fa463d9d693b29481c7/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-18 23:12:57,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/hbase/namespace/223a7e9433605c67093dc1c37dd2dbc5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 23:12:57,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 23:12:57,364 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689721813339.82c0ae918e241fa463d9d693b29481c7. 2023-07-18 23:12:57,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 23:12:57,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 82c0ae918e241fa463d9d693b29481c7: 2023-07-18 23:12:57,365 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689721812495.223a7e9433605c67093dc1c37dd2dbc5. 2023-07-18 23:12:57,365 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 223a7e9433605c67093dc1c37dd2dbc5: 2023-07-18 23:12:57,365 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689721812495.223a7e9433605c67093dc1c37dd2dbc5. 2023-07-18 23:12:57,365 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689721813339.82c0ae918e241fa463d9d693b29481c7. 2023-07-18 23:12:57,368 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3b47e40ac0314e3e8d0dcd100a992631 2023-07-18 23:12:57,381 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/hbase/meta/1588230740/.tmp/table/b3498753e1ed4fa6952b4d635caa0eda 2023-07-18 23:12:57,386 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b3498753e1ed4fa6952b4d635caa0eda 2023-07-18 23:12:57,387 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/hbase/meta/1588230740/.tmp/info/7f5ebca77e564995b163e9f14445239b as hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/hbase/meta/1588230740/info/7f5ebca77e564995b163e9f14445239b 2023-07-18 23:12:57,392 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7f5ebca77e564995b163e9f14445239b 2023-07-18 23:12:57,392 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/hbase/meta/1588230740/info/7f5ebca77e564995b163e9f14445239b, entries=48, sequenceid=131, filesize=10.3 K 2023-07-18 23:12:57,392 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/hbase/meta/1588230740/.tmp/rep_barrier/3b47e40ac0314e3e8d0dcd100a992631 as hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/hbase/meta/1588230740/rep_barrier/3b47e40ac0314e3e8d0dcd100a992631 2023-07-18 23:12:57,397 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3b47e40ac0314e3e8d0dcd100a992631 2023-07-18 23:12:57,397 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/hbase/meta/1588230740/rep_barrier/3b47e40ac0314e3e8d0dcd100a992631, entries=13, sequenceid=131, filesize=6.4 K 2023-07-18 23:12:57,398 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/hbase/meta/1588230740/.tmp/table/b3498753e1ed4fa6952b4d635caa0eda as hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/hbase/meta/1588230740/table/b3498753e1ed4fa6952b4d635caa0eda 2023-07-18 23:12:57,409 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b3498753e1ed4fa6952b4d635caa0eda 2023-07-18 23:12:57,409 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/hbase/meta/1588230740/table/b3498753e1ed4fa6952b4d635caa0eda, entries=24, sequenceid=131, filesize=6.9 K 2023-07-18 23:12:57,410 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 138ms, sequenceid=131, compaction requested=false 2023-07-18 23:12:57,435 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-18 23:12:57,436 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 23:12:57,436 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-18 23:12:57,441 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-18 23:12:57,441 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-18 23:12:57,442 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-18 23:12:57,443 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 23:12:57,443 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:12:57,443 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:12:57,443 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 23:12:57,443 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38625,1689721809654 2023-07-18 23:12:57,443 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 23:12:57,443 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 23:12:57,445 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38625,1689721809654] 2023-07-18 23:12:57,446 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38625,1689721809654; numProcessing=1 2023-07-18 23:12:57,466 INFO [RS:0;jenkins-hbase4:45387] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,45387,1689721809516; all regions closed. 2023-07-18 23:12:57,472 INFO [RS:1;jenkins-hbase4:45431] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,45431,1689721809599; all regions closed. 2023-07-18 23:12:57,473 DEBUG [RS:0;jenkins-hbase4:45387] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/oldWALs 2023-07-18 23:12:57,473 INFO [RS:0;jenkins-hbase4:45387] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45387%2C1689721809516.meta:.meta(num 1689721812146) 2023-07-18 23:12:57,482 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/WALs/jenkins-hbase4.apache.org,45387,1689721809516/jenkins-hbase4.apache.org%2C45387%2C1689721809516.1689721811936 not finished, retry = 0 2023-07-18 23:12:57,484 DEBUG [RS:1;jenkins-hbase4:45431] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/oldWALs 2023-07-18 23:12:57,484 INFO [RS:1;jenkins-hbase4:45431] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45431%2C1689721809599:(num 1689721811934) 2023-07-18 23:12:57,484 DEBUG [RS:1;jenkins-hbase4:45431] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 23:12:57,484 INFO [RS:1;jenkins-hbase4:45431] regionserver.LeaseManager(133): Closed leases 2023-07-18 23:12:57,484 INFO [RS:1;jenkins-hbase4:45431] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-18 23:12:57,485 INFO [RS:1;jenkins-hbase4:45431] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-18 23:12:57,485 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-18 23:12:57,485 INFO [RS:1;jenkins-hbase4:45431] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-18 23:12:57,485 INFO [RS:1;jenkins-hbase4:45431] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-18 23:12:57,486 INFO [RS:1;jenkins-hbase4:45431] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45431 2023-07-18 23:12:57,585 DEBUG [RS:0;jenkins-hbase4:45387] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/oldWALs 2023-07-18 23:12:57,585 INFO [RS:0;jenkins-hbase4:45387] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45387%2C1689721809516:(num 1689721811936) 2023-07-18 23:12:57,585 DEBUG [RS:0;jenkins-hbase4:45387] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 23:12:57,585 INFO [RS:0;jenkins-hbase4:45387] regionserver.LeaseManager(133): Closed leases 2023-07-18 23:12:57,585 INFO [RS:0;jenkins-hbase4:45387] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-18 23:12:57,585 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-18 23:12:57,587 INFO [RS:0;jenkins-hbase4:45387] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45387 2023-07-18 23:12:57,596 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:12:57,597 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38625,1689721809654 already deleted, retry=false 2023-07-18 23:12:57,597 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 23:12:57,597 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38625,1689721809654 expired; onlineServers=2 2023-07-18 23:12:57,597 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45431,1689721809599 2023-07-18 23:12:57,626 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 23:12:57,626 INFO [RS:2;jenkins-hbase4:38625] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,38625,1689721809654; zookeeper connection closed. 2023-07-18 23:12:57,626 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:38625-0x1017ab3231c0003, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 23:12:57,627 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4f14d191] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4f14d191 2023-07-18 23:12:57,711 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:12:57,711 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45431,1689721809599] 2023-07-18 23:12:57,711 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45387,1689721809516 2023-07-18 23:12:57,711 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45431,1689721809599; numProcessing=2 2023-07-18 23:12:57,872 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45431,1689721809599 already deleted, retry=false 2023-07-18 23:12:57,872 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45431,1689721809599 expired; onlineServers=1 2023-07-18 23:12:57,872 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45387,1689721809516] 2023-07-18 23:12:57,872 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45387,1689721809516; numProcessing=3 2023-07-18 23:12:57,888 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 23:12:57,888 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x1017ab3231c0002, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 23:12:57,888 INFO [RS:1;jenkins-hbase4:45431] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,45431,1689721809599; zookeeper connection closed. 2023-07-18 23:12:57,888 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@31bfa724] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@31bfa724 2023-07-18 23:12:57,927 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45387,1689721809516 already deleted, retry=false 2023-07-18 23:12:57,927 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45387,1689721809516 expired; onlineServers=0 2023-07-18 23:12:57,927 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,46651,1689721807857' ***** 2023-07-18 23:12:57,927 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-18 23:12:57,927 DEBUG [M:0;jenkins-hbase4:46651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@681c0fd0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-18 23:12:57,927 INFO [M:0;jenkins-hbase4:46651] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,46651,1689721807857 2023-07-18 23:12:57,927 INFO [M:0;jenkins-hbase4:46651] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,46651,1689721807857; all regions closed. 2023-07-18 23:12:57,927 DEBUG [M:0;jenkins-hbase4:46651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 23:12:57,927 DEBUG [M:0;jenkins-hbase4:46651] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-18 23:12:57,927 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-18 23:12:57,927 DEBUG [M:0;jenkins-hbase4:46651] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-18 23:12:57,927 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689721811419] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689721811419,5,FailOnTimeoutGroup] 2023-07-18 23:12:57,927 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689721811418] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689721811418,5,FailOnTimeoutGroup] 2023-07-18 23:12:57,928 INFO [M:0;jenkins-hbase4:46651] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-18 23:12:57,928 INFO [M:0;jenkins-hbase4:46651] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-18 23:12:57,928 INFO [M:0;jenkins-hbase4:46651] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-18 23:12:57,928 DEBUG [M:0;jenkins-hbase4:46651] master.HMaster(1512): Stopping service threads 2023-07-18 23:12:57,928 INFO [M:0;jenkins-hbase4:46651] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-18 23:12:57,928 ERROR [M:0;jenkins-hbase4:46651] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-18 23:12:57,929 INFO [M:0;jenkins-hbase4:46651] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-18 23:12:57,929 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-18 23:12:57,988 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 23:12:57,988 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1017ab3231c0001, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 23:12:57,988 INFO [RS:0;jenkins-hbase4:45387] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,45387,1689721809516; zookeeper connection closed. 2023-07-18 23:12:57,989 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7a6514a3] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7a6514a3 2023-07-18 23:12:57,989 INFO [Listener at jenkins-hbase4.apache.org/33217] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-18 23:12:58,003 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-18 23:12:58,003 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 23:12:58,003 DEBUG [M:0;jenkins-hbase4:46651] zookeeper.ZKUtil(398): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-18 23:12:58,003 WARN [M:0;jenkins-hbase4:46651] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-18 23:12:58,003 INFO [M:0;jenkins-hbase4:46651] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-18 23:12:58,003 INFO [M:0;jenkins-hbase4:46651] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-18 23:12:58,003 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-18 23:12:58,004 DEBUG [M:0;jenkins-hbase4:46651] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-18 23:12:58,004 INFO [M:0;jenkins-hbase4:46651] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 23:12:58,004 DEBUG [M:0;jenkins-hbase4:46651] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 23:12:58,004 DEBUG [M:0;jenkins-hbase4:46651] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-18 23:12:58,004 DEBUG [M:0;jenkins-hbase4:46651] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 23:12:58,004 INFO [M:0;jenkins-hbase4:46651] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=373.39 KB heapSize=449.59 KB 2023-07-18 23:12:58,021 INFO [M:0;jenkins-hbase4:46651] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=373.39 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/a8f0e12e4df8435ba3dd41a950fa7cc6 2023-07-18 23:12:58,025 INFO [M:0;jenkins-hbase4:46651] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a8f0e12e4df8435ba3dd41a950fa7cc6 2023-07-18 23:12:58,026 DEBUG [M:0;jenkins-hbase4:46651] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/a8f0e12e4df8435ba3dd41a950fa7cc6 as hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/a8f0e12e4df8435ba3dd41a950fa7cc6 2023-07-18 23:12:58,030 INFO [M:0;jenkins-hbase4:46651] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a8f0e12e4df8435ba3dd41a950fa7cc6 2023-07-18 23:12:58,030 INFO [M:0;jenkins-hbase4:46651] regionserver.HStore(1080): Added hdfs://localhost:45655/user/jenkins/test-data/43f75e06-42e8-3a4b-3019-84cfeec3e054/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/a8f0e12e4df8435ba3dd41a950fa7cc6, entries=119, sequenceid=899, filesize=28.5 K 2023-07-18 23:12:58,031 INFO [M:0;jenkins-hbase4:46651] regionserver.HRegion(2948): Finished flush of dataSize ~373.39 KB/382356, heapSize ~449.58 KB/460368, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 27ms, sequenceid=899, compaction requested=false 2023-07-18 23:12:58,032 INFO [M:0;jenkins-hbase4:46651] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 23:12:58,032 DEBUG [M:0;jenkins-hbase4:46651] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-18 23:12:58,036 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-18 23:12:58,036 INFO [M:0;jenkins-hbase4:46651] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-18 23:12:58,037 INFO [M:0;jenkins-hbase4:46651] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46651 2023-07-18 23:12:58,053 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 23:12:58,053 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-18 23:12:58,053 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 23:12:58,053 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-18 23:12:58,053 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 23:12:58,126 DEBUG [M:0;jenkins-hbase4:46651] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,46651,1689721807857 already deleted, retry=false 2023-07-18 23:12:58,327 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 23:12:58,327 DEBUG [Listener at localhost/42081-EventThread] zookeeper.ZKWatcher(600): master:46651-0x1017ab3231c0000, quorum=127.0.0.1:61306, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 23:12:58,327 INFO [M:0;jenkins-hbase4:46651] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,46651,1689721807857; zookeeper connection closed. 2023-07-18 23:12:58,329 WARN [Listener at jenkins-hbase4.apache.org/33217] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-18 23:12:58,343 INFO [Listener at jenkins-hbase4.apache.org/33217] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-18 23:12:58,450 WARN [BP-1308311443-172.31.14.131-1689721803461 heartbeating to localhost/127.0.0.1:45655] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-18 23:12:58,450 WARN [BP-1308311443-172.31.14.131-1689721803461 heartbeating to localhost/127.0.0.1:45655] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1308311443-172.31.14.131-1689721803461 (Datanode Uuid 847cb047-f2f4-4432-a2f5-fe36d5f18a78) service to localhost/127.0.0.1:45655 2023-07-18 23:12:58,452 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/cluster_58864cd1-a7cd-0177-9e77-6a825cf5c04f/dfs/data/data5/current/BP-1308311443-172.31.14.131-1689721803461] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 23:12:58,452 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/cluster_58864cd1-a7cd-0177-9e77-6a825cf5c04f/dfs/data/data6/current/BP-1308311443-172.31.14.131-1689721803461] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 23:12:58,454 WARN [Listener at jenkins-hbase4.apache.org/33217] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-18 23:12:58,458 INFO [Listener at jenkins-hbase4.apache.org/33217] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-18 23:12:58,561 WARN [BP-1308311443-172.31.14.131-1689721803461 heartbeating to localhost/127.0.0.1:45655] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-18 23:12:58,562 WARN [BP-1308311443-172.31.14.131-1689721803461 heartbeating to localhost/127.0.0.1:45655] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1308311443-172.31.14.131-1689721803461 (Datanode Uuid 74c8d802-e18c-45af-96e4-7708018042c6) service to localhost/127.0.0.1:45655 2023-07-18 23:12:58,562 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/cluster_58864cd1-a7cd-0177-9e77-6a825cf5c04f/dfs/data/data3/current/BP-1308311443-172.31.14.131-1689721803461] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 23:12:58,563 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/cluster_58864cd1-a7cd-0177-9e77-6a825cf5c04f/dfs/data/data4/current/BP-1308311443-172.31.14.131-1689721803461] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 23:12:58,564 WARN [Listener at jenkins-hbase4.apache.org/33217] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-18 23:12:58,582 INFO [Listener at jenkins-hbase4.apache.org/33217] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-18 23:12:58,586 WARN [BP-1308311443-172.31.14.131-1689721803461 heartbeating to localhost/127.0.0.1:45655] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-18 23:12:58,586 WARN [BP-1308311443-172.31.14.131-1689721803461 heartbeating to localhost/127.0.0.1:45655] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1308311443-172.31.14.131-1689721803461 (Datanode Uuid 9f1008fa-b258-4a68-bf5e-75608439f464) service to localhost/127.0.0.1:45655 2023-07-18 23:12:58,587 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/cluster_58864cd1-a7cd-0177-9e77-6a825cf5c04f/dfs/data/data2/current/BP-1308311443-172.31.14.131-1689721803461] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 23:12:58,588 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa2007ab-e09b-a16d-b122-406f9547eac5/cluster_58864cd1-a7cd-0177-9e77-6a825cf5c04f/dfs/data/data1/current/BP-1308311443-172.31.14.131-1689721803461] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 23:12:58,617 INFO [Listener at jenkins-hbase4.apache.org/33217] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-18 23:12:58,748 INFO [Listener at jenkins-hbase4.apache.org/33217] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-18 23:12:58,937 INFO [Listener at jenkins-hbase4.apache.org/33217] hbase.HBaseTestingUtility(1293): Minicluster is down