2023-07-24 17:06:23,111 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-24 17:06:23,385 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7 2023-07-24 17:06:23,385 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot timeout: 13 mins 2023-07-24 17:06:23,430 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-24 17:06:23,655 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-24 17:06:23,656 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/cluster_4cc708a3-96e2-4835-db32-d049ee6d4ce3, deleteOnExit=true 2023-07-24 17:06:23,656 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-24 17:06:23,657 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/test.cache.data in system properties and HBase conf 2023-07-24 17:06:23,657 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/hadoop.tmp.dir in system properties and HBase conf 2023-07-24 17:06:23,657 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/hadoop.log.dir in system properties and HBase conf 2023-07-24 17:06:23,658 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-24 17:06:23,658 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-24 17:06:23,658 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-24 17:06:23,968 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-24 17:06:23,973 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-24 17:06:23,974 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-24 17:06:23,974 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-24 17:06:23,975 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-24 17:06:23,975 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-24 17:06:23,976 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-24 17:06:23,976 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-24 17:06:23,977 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-24 17:06:23,977 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-24 17:06:23,978 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/nfs.dump.dir in system properties and HBase conf 2023-07-24 17:06:23,978 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/java.io.tmpdir in system properties and HBase conf 2023-07-24 17:06:23,978 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-24 17:06:23,979 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-24 17:06:23,979 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-24 17:06:24,585 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-24 17:06:24,589 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-24 17:06:24,875 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-24 17:06:25,067 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-24 17:06:25,082 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 17:06:25,116 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 17:06:25,148 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/java.io.tmpdir/Jetty_localhost_40567_hdfs____mdg8ro/webapp 2023-07-24 17:06:25,298 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40567 2023-07-24 17:06:25,352 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-24 17:06:25,352 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-24 17:06:25,879 WARN [Listener at localhost/41733] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-24 17:06:25,968 WARN [Listener at localhost/41733] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-24 17:06:25,993 WARN [Listener at localhost/41733] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 17:06:26,002 INFO [Listener at localhost/41733] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 17:06:26,010 INFO [Listener at localhost/41733] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/java.io.tmpdir/Jetty_localhost_40453_datanode____.eiw56r/webapp 2023-07-24 17:06:26,163 INFO [Listener at localhost/41733] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40453 2023-07-24 17:06:26,712 WARN [Listener at localhost/44001] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-24 17:06:26,753 WARN [Listener at localhost/44001] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-24 17:06:26,762 WARN [Listener at localhost/44001] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 17:06:26,765 INFO [Listener at localhost/44001] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 17:06:26,779 INFO [Listener at localhost/44001] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/java.io.tmpdir/Jetty_localhost_45041_datanode____3no9kj/webapp 2023-07-24 17:06:26,911 INFO [Listener at localhost/44001] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45041 2023-07-24 17:06:26,928 WARN [Listener at localhost/34251] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-24 17:06:26,944 WARN [Listener at localhost/34251] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-24 17:06:26,947 WARN [Listener at localhost/34251] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 17:06:26,949 INFO [Listener at localhost/34251] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 17:06:26,956 INFO [Listener at localhost/34251] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/java.io.tmpdir/Jetty_localhost_35065_datanode____g6bv78/webapp 2023-07-24 17:06:27,099 INFO [Listener at localhost/34251] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35065 2023-07-24 17:06:27,130 WARN [Listener at localhost/37397] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-24 17:06:27,400 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x52deacc482e89e18: Processing first storage report for DS-7f916e9b-3c73-4c42-ad6e-ff15d84ab426 from datanode dd03fff4-f7b9-4819-9dec-c00e282f7fd6 2023-07-24 17:06:27,402 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x52deacc482e89e18: from storage DS-7f916e9b-3c73-4c42-ad6e-ff15d84ab426 node DatanodeRegistration(127.0.0.1:35227, datanodeUuid=dd03fff4-f7b9-4819-9dec-c00e282f7fd6, infoPort=35969, infoSecurePort=0, ipcPort=44001, storageInfo=lv=-57;cid=testClusterID;nsid=738509245;c=1690218384659), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-24 17:06:27,402 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcd0469287d447a4d: Processing first storage report for DS-0a7735c5-6cf8-4930-a560-de4955f49346 from datanode 8276aedc-77c7-41a6-8382-f0e0b3cbb28d 2023-07-24 17:06:27,403 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcd0469287d447a4d: from storage DS-0a7735c5-6cf8-4930-a560-de4955f49346 node DatanodeRegistration(127.0.0.1:43065, datanodeUuid=8276aedc-77c7-41a6-8382-f0e0b3cbb28d, infoPort=44927, infoSecurePort=0, ipcPort=37397, storageInfo=lv=-57;cid=testClusterID;nsid=738509245;c=1690218384659), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-24 17:06:27,403 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3e904f5d1a4db56e: Processing first storage report for DS-8d362f52-fcf7-4bda-93bb-4ebe68056178 from datanode 969d041e-e829-4e9d-b5f7-e68f89910049 2023-07-24 17:06:27,403 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3e904f5d1a4db56e: from storage DS-8d362f52-fcf7-4bda-93bb-4ebe68056178 node DatanodeRegistration(127.0.0.1:42393, datanodeUuid=969d041e-e829-4e9d-b5f7-e68f89910049, infoPort=38911, infoSecurePort=0, ipcPort=34251, storageInfo=lv=-57;cid=testClusterID;nsid=738509245;c=1690218384659), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-24 17:06:27,403 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x52deacc482e89e18: Processing first storage report for DS-b4c5e8ee-1fd1-4cca-bdc0-aa61335d4d38 from datanode dd03fff4-f7b9-4819-9dec-c00e282f7fd6 2023-07-24 17:06:27,403 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x52deacc482e89e18: from storage DS-b4c5e8ee-1fd1-4cca-bdc0-aa61335d4d38 node DatanodeRegistration(127.0.0.1:35227, datanodeUuid=dd03fff4-f7b9-4819-9dec-c00e282f7fd6, infoPort=35969, infoSecurePort=0, ipcPort=44001, storageInfo=lv=-57;cid=testClusterID;nsid=738509245;c=1690218384659), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-24 17:06:27,404 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcd0469287d447a4d: Processing first storage report for DS-609fc4f2-a664-4fce-b62e-7bd556704812 from datanode 8276aedc-77c7-41a6-8382-f0e0b3cbb28d 2023-07-24 17:06:27,404 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcd0469287d447a4d: from storage DS-609fc4f2-a664-4fce-b62e-7bd556704812 node DatanodeRegistration(127.0.0.1:43065, datanodeUuid=8276aedc-77c7-41a6-8382-f0e0b3cbb28d, infoPort=44927, infoSecurePort=0, ipcPort=37397, storageInfo=lv=-57;cid=testClusterID;nsid=738509245;c=1690218384659), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-24 17:06:27,404 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3e904f5d1a4db56e: Processing first storage report for DS-15b96082-e3c4-4276-8ac6-6191f5ce2c2e from datanode 969d041e-e829-4e9d-b5f7-e68f89910049 2023-07-24 17:06:27,404 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3e904f5d1a4db56e: from storage DS-15b96082-e3c4-4276-8ac6-6191f5ce2c2e node DatanodeRegistration(127.0.0.1:42393, datanodeUuid=969d041e-e829-4e9d-b5f7-e68f89910049, infoPort=38911, infoSecurePort=0, ipcPort=34251, storageInfo=lv=-57;cid=testClusterID;nsid=738509245;c=1690218384659), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-24 17:06:27,657 DEBUG [Listener at localhost/37397] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7 2023-07-24 17:06:27,730 INFO [Listener at localhost/37397] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/cluster_4cc708a3-96e2-4835-db32-d049ee6d4ce3/zookeeper_0, clientPort=49884, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/cluster_4cc708a3-96e2-4835-db32-d049ee6d4ce3/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/cluster_4cc708a3-96e2-4835-db32-d049ee6d4ce3/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-24 17:06:27,746 INFO [Listener at localhost/37397] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=49884 2023-07-24 17:06:27,754 INFO [Listener at localhost/37397] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 17:06:27,755 INFO [Listener at localhost/37397] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 17:06:28,464 INFO [Listener at localhost/37397] util.FSUtils(471): Created version file at hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d with version=8 2023-07-24 17:06:28,464 INFO [Listener at localhost/37397] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/hbase-staging 2023-07-24 17:06:28,836 INFO [Listener at localhost/37397] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-24 17:06:29,404 INFO [Listener at localhost/37397] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-24 17:06:29,447 INFO [Listener at localhost/37397] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 17:06:29,448 INFO [Listener at localhost/37397] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-24 17:06:29,448 INFO [Listener at localhost/37397] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-24 17:06:29,448 INFO [Listener at localhost/37397] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 17:06:29,448 INFO [Listener at localhost/37397] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-24 17:06:29,640 INFO [Listener at localhost/37397] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-24 17:06:29,737 DEBUG [Listener at localhost/37397] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-24 17:06:29,845 INFO [Listener at localhost/37397] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46651 2023-07-24 17:06:29,860 INFO [Listener at localhost/37397] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 17:06:29,862 INFO [Listener at localhost/37397] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 17:06:29,885 INFO [Listener at localhost/37397] zookeeper.RecoverableZooKeeper(93): Process identifier=master:46651 connecting to ZooKeeper ensemble=127.0.0.1:49884 2023-07-24 17:06:29,941 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:466510x0, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-24 17:06:29,944 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:46651-0x101984c5c040000 connected 2023-07-24 17:06:29,976 DEBUG [Listener at localhost/37397] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 17:06:29,977 DEBUG [Listener at localhost/37397] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 17:06:29,996 DEBUG [Listener at localhost/37397] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-24 17:06:30,008 DEBUG [Listener at localhost/37397] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46651 2023-07-24 17:06:30,013 DEBUG [Listener at localhost/37397] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46651 2023-07-24 17:06:30,014 DEBUG [Listener at localhost/37397] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46651 2023-07-24 17:06:30,019 DEBUG [Listener at localhost/37397] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46651 2023-07-24 17:06:30,019 DEBUG [Listener at localhost/37397] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46651 2023-07-24 17:06:30,027 INFO [Listener at localhost/37397] master.HMaster(444): hbase.rootdir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d, hbase.cluster.distributed=false 2023-07-24 17:06:30,104 INFO [Listener at localhost/37397] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-24 17:06:30,104 INFO [Listener at localhost/37397] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 17:06:30,105 INFO [Listener at localhost/37397] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-24 17:06:30,105 INFO [Listener at localhost/37397] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-24 17:06:30,105 INFO [Listener at localhost/37397] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 17:06:30,105 INFO [Listener at localhost/37397] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-24 17:06:30,112 INFO [Listener at localhost/37397] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-24 17:06:30,116 INFO [Listener at localhost/37397] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44109 2023-07-24 17:06:30,119 INFO [Listener at localhost/37397] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-24 17:06:30,137 DEBUG [Listener at localhost/37397] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-24 17:06:30,139 INFO [Listener at localhost/37397] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 17:06:30,141 INFO [Listener at localhost/37397] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 17:06:30,144 INFO [Listener at localhost/37397] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44109 connecting to ZooKeeper ensemble=127.0.0.1:49884 2023-07-24 17:06:30,149 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:441090x0, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-24 17:06:30,151 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44109-0x101984c5c040001 connected 2023-07-24 17:06:30,151 DEBUG [Listener at localhost/37397] zookeeper.ZKUtil(164): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 17:06:30,152 DEBUG [Listener at localhost/37397] zookeeper.ZKUtil(164): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 17:06:30,153 DEBUG [Listener at localhost/37397] zookeeper.ZKUtil(164): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-24 17:06:30,154 DEBUG [Listener at localhost/37397] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44109 2023-07-24 17:06:30,155 DEBUG [Listener at localhost/37397] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44109 2023-07-24 17:06:30,155 DEBUG [Listener at localhost/37397] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44109 2023-07-24 17:06:30,159 DEBUG [Listener at localhost/37397] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44109 2023-07-24 17:06:30,162 DEBUG [Listener at localhost/37397] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44109 2023-07-24 17:06:30,175 INFO [Listener at localhost/37397] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-24 17:06:30,175 INFO [Listener at localhost/37397] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 17:06:30,176 INFO [Listener at localhost/37397] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-24 17:06:30,176 INFO [Listener at localhost/37397] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-24 17:06:30,176 INFO [Listener at localhost/37397] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 17:06:30,177 INFO [Listener at localhost/37397] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-24 17:06:30,177 INFO [Listener at localhost/37397] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-24 17:06:30,179 INFO [Listener at localhost/37397] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43483 2023-07-24 17:06:30,180 INFO [Listener at localhost/37397] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-24 17:06:30,182 DEBUG [Listener at localhost/37397] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-24 17:06:30,183 INFO [Listener at localhost/37397] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 17:06:30,185 INFO [Listener at localhost/37397] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 17:06:30,188 INFO [Listener at localhost/37397] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43483 connecting to ZooKeeper ensemble=127.0.0.1:49884 2023-07-24 17:06:30,194 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:434830x0, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-24 17:06:30,195 DEBUG [Listener at localhost/37397] zookeeper.ZKUtil(164): regionserver:434830x0, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 17:06:30,196 DEBUG [Listener at localhost/37397] zookeeper.ZKUtil(164): regionserver:434830x0, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 17:06:30,196 DEBUG [Listener at localhost/37397] zookeeper.ZKUtil(164): regionserver:434830x0, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-24 17:06:30,199 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:43483-0x101984c5c040002 connected 2023-07-24 17:06:30,199 DEBUG [Listener at localhost/37397] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43483 2023-07-24 17:06:30,199 DEBUG [Listener at localhost/37397] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43483 2023-07-24 17:06:30,202 DEBUG [Listener at localhost/37397] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43483 2023-07-24 17:06:30,207 DEBUG [Listener at localhost/37397] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43483 2023-07-24 17:06:30,207 DEBUG [Listener at localhost/37397] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43483 2023-07-24 17:06:30,226 INFO [Listener at localhost/37397] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-24 17:06:30,226 INFO [Listener at localhost/37397] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 17:06:30,226 INFO [Listener at localhost/37397] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-24 17:06:30,226 INFO [Listener at localhost/37397] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-24 17:06:30,226 INFO [Listener at localhost/37397] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 17:06:30,227 INFO [Listener at localhost/37397] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-24 17:06:30,227 INFO [Listener at localhost/37397] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-24 17:06:30,232 INFO [Listener at localhost/37397] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37115 2023-07-24 17:06:30,232 INFO [Listener at localhost/37397] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-24 17:06:30,238 DEBUG [Listener at localhost/37397] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-24 17:06:30,240 INFO [Listener at localhost/37397] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 17:06:30,241 INFO [Listener at localhost/37397] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 17:06:30,243 INFO [Listener at localhost/37397] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37115 connecting to ZooKeeper ensemble=127.0.0.1:49884 2023-07-24 17:06:30,247 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:371150x0, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-24 17:06:30,249 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:37115-0x101984c5c040003 connected 2023-07-24 17:06:30,249 DEBUG [Listener at localhost/37397] zookeeper.ZKUtil(164): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 17:06:30,250 DEBUG [Listener at localhost/37397] zookeeper.ZKUtil(164): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 17:06:30,251 DEBUG [Listener at localhost/37397] zookeeper.ZKUtil(164): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-24 17:06:30,251 DEBUG [Listener at localhost/37397] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37115 2023-07-24 17:06:30,257 DEBUG [Listener at localhost/37397] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37115 2023-07-24 17:06:30,257 DEBUG [Listener at localhost/37397] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37115 2023-07-24 17:06:30,258 DEBUG [Listener at localhost/37397] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37115 2023-07-24 17:06:30,258 DEBUG [Listener at localhost/37397] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37115 2023-07-24 17:06:30,261 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,46651,1690218388662 2023-07-24 17:06:30,273 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-24 17:06:30,275 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,46651,1690218388662 2023-07-24 17:06:30,298 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-24 17:06:30,298 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-24 17:06:30,298 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-24 17:06:30,298 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-24 17:06:30,298 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 17:06:30,300 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-24 17:06:30,302 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-24 17:06:30,303 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,46651,1690218388662 from backup master directory 2023-07-24 17:06:30,307 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,46651,1690218388662 2023-07-24 17:06:30,308 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-24 17:06:30,309 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-24 17:06:30,309 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,46651,1690218388662 2023-07-24 17:06:30,314 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-24 17:06:30,316 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-24 17:06:30,433 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/hbase.id with ID: cfee4570-96c0-49cc-88f4-871aa6701550 2023-07-24 17:06:30,482 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 17:06:30,498 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 17:06:30,573 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x7235e2fd to 127.0.0.1:49884 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:06:30,637 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b420641, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:06:30,665 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-24 17:06:30,668 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-24 17:06:30,695 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-24 17:06:30,695 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-24 17:06:30,697 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-24 17:06:30,704 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-24 17:06:30,705 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 17:06:30,758 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/MasterData/data/master/store-tmp 2023-07-24 17:06:30,850 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:06:30,850 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-24 17:06:30,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 17:06:30,851 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 17:06:30,851 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-24 17:06:30,851 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 17:06:30,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 17:06:30,851 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-24 17:06:30,853 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/MasterData/WALs/jenkins-hbase4.apache.org,46651,1690218388662 2023-07-24 17:06:30,885 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46651%2C1690218388662, suffix=, logDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/MasterData/WALs/jenkins-hbase4.apache.org,46651,1690218388662, archiveDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/MasterData/oldWALs, maxLogs=10 2023-07-24 17:06:30,972 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43065,DS-0a7735c5-6cf8-4930-a560-de4955f49346,DISK] 2023-07-24 17:06:30,972 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35227,DS-7f916e9b-3c73-4c42-ad6e-ff15d84ab426,DISK] 2023-07-24 17:06:30,972 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42393,DS-8d362f52-fcf7-4bda-93bb-4ebe68056178,DISK] 2023-07-24 17:06:30,983 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-24 17:06:31,074 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/MasterData/WALs/jenkins-hbase4.apache.org,46651,1690218388662/jenkins-hbase4.apache.org%2C46651%2C1690218388662.1690218390900 2023-07-24 17:06:31,074 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43065,DS-0a7735c5-6cf8-4930-a560-de4955f49346,DISK], DatanodeInfoWithStorage[127.0.0.1:42393,DS-8d362f52-fcf7-4bda-93bb-4ebe68056178,DISK], DatanodeInfoWithStorage[127.0.0.1:35227,DS-7f916e9b-3c73-4c42-ad6e-ff15d84ab426,DISK]] 2023-07-24 17:06:31,075 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-24 17:06:31,076 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:06:31,080 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-24 17:06:31,081 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-24 17:06:31,174 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-24 17:06:31,183 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-24 17:06:31,224 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-24 17:06:31,240 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 17:06:31,248 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-24 17:06:31,251 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-24 17:06:31,272 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-24 17:06:31,277 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 17:06:31,278 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72848469, jitterRate=0.08552677929401398}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 17:06:31,278 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-24 17:06:31,280 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-24 17:06:31,305 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-24 17:06:31,305 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-24 17:06:31,307 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-24 17:06:31,309 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-24 17:06:31,353 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 43 msec 2023-07-24 17:06:31,353 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-24 17:06:31,392 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-24 17:06:31,400 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-24 17:06:31,435 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-24 17:06:31,442 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-24 17:06:31,445 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-24 17:06:31,453 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-24 17:06:31,459 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-24 17:06:31,465 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 17:06:31,467 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-24 17:06:31,467 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-24 17:06:31,481 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-24 17:06:31,486 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-24 17:06:31,486 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-24 17:06:31,486 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-24 17:06:31,486 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 17:06:31,486 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-24 17:06:31,487 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,46651,1690218388662, sessionid=0x101984c5c040000, setting cluster-up flag (Was=false) 2023-07-24 17:06:31,513 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 17:06:31,529 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-24 17:06:31,532 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,46651,1690218388662 2023-07-24 17:06:31,538 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 17:06:31,552 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-24 17:06:31,555 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,46651,1690218388662 2023-07-24 17:06:31,558 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/.tmp 2023-07-24 17:06:31,573 INFO [RS:0;jenkins-hbase4:44109] regionserver.HRegionServer(951): ClusterId : cfee4570-96c0-49cc-88f4-871aa6701550 2023-07-24 17:06:31,591 INFO [RS:2;jenkins-hbase4:37115] regionserver.HRegionServer(951): ClusterId : cfee4570-96c0-49cc-88f4-871aa6701550 2023-07-24 17:06:31,599 INFO [RS:1;jenkins-hbase4:43483] regionserver.HRegionServer(951): ClusterId : cfee4570-96c0-49cc-88f4-871aa6701550 2023-07-24 17:06:31,599 DEBUG [RS:1;jenkins-hbase4:43483] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-24 17:06:31,599 DEBUG [RS:0;jenkins-hbase4:44109] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-24 17:06:31,599 DEBUG [RS:2;jenkins-hbase4:37115] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-24 17:06:31,612 DEBUG [RS:1;jenkins-hbase4:43483] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-24 17:06:31,612 DEBUG [RS:2;jenkins-hbase4:37115] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-24 17:06:31,612 DEBUG [RS:0;jenkins-hbase4:44109] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-24 17:06:31,613 DEBUG [RS:2;jenkins-hbase4:37115] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-24 17:06:31,613 DEBUG [RS:1;jenkins-hbase4:43483] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-24 17:06:31,613 DEBUG [RS:0;jenkins-hbase4:44109] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-24 17:06:31,619 DEBUG [RS:1;jenkins-hbase4:43483] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-24 17:06:31,621 DEBUG [RS:1;jenkins-hbase4:43483] zookeeper.ReadOnlyZKClient(139): Connect 0x4936c287 to 127.0.0.1:49884 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:06:31,626 DEBUG [RS:2;jenkins-hbase4:37115] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-24 17:06:31,626 DEBUG [RS:0;jenkins-hbase4:44109] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-24 17:06:31,631 DEBUG [RS:2;jenkins-hbase4:37115] zookeeper.ReadOnlyZKClient(139): Connect 0x76486012 to 127.0.0.1:49884 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:06:31,640 DEBUG [RS:0;jenkins-hbase4:44109] zookeeper.ReadOnlyZKClient(139): Connect 0x0fb38203 to 127.0.0.1:49884 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:06:31,647 DEBUG [RS:2;jenkins-hbase4:37115] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@788f80ab, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:06:31,648 DEBUG [RS:2;jenkins-hbase4:37115] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7cb00b62, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-24 17:06:31,667 DEBUG [RS:1;jenkins-hbase4:43483] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@395ba0f6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:06:31,667 DEBUG [RS:1;jenkins-hbase4:43483] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ef028a8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-24 17:06:31,693 DEBUG [RS:0;jenkins-hbase4:44109] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1feee126, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:06:31,693 DEBUG [RS:0;jenkins-hbase4:44109] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e301c35, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-24 17:06:31,698 DEBUG [RS:2;jenkins-hbase4:37115] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:37115 2023-07-24 17:06:31,701 DEBUG [RS:1;jenkins-hbase4:43483] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:43483 2023-07-24 17:06:31,705 INFO [RS:1;jenkins-hbase4:43483] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-24 17:06:31,710 INFO [RS:1;jenkins-hbase4:43483] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-24 17:06:31,705 INFO [RS:2;jenkins-hbase4:37115] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-24 17:06:31,711 INFO [RS:2;jenkins-hbase4:37115] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-24 17:06:31,711 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-24 17:06:31,712 DEBUG [RS:0;jenkins-hbase4:44109] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:44109 2023-07-24 17:06:31,712 INFO [RS:0;jenkins-hbase4:44109] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-24 17:06:31,712 INFO [RS:0;jenkins-hbase4:44109] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-24 17:06:31,716 DEBUG [RS:2;jenkins-hbase4:37115] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-24 17:06:31,716 DEBUG [RS:1;jenkins-hbase4:43483] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-24 17:06:31,716 DEBUG [RS:0;jenkins-hbase4:44109] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-24 17:06:31,717 INFO [RS:2;jenkins-hbase4:37115] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 17:06:31,718 DEBUG [RS:2;jenkins-hbase4:37115] regionserver.HRegionServer(1022): About to register with Master. 2023-07-24 17:06:31,718 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 17:06:31,717 INFO [RS:0;jenkins-hbase4:44109] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 17:06:31,718 DEBUG [RS:0;jenkins-hbase4:44109] regionserver.HRegionServer(1022): About to register with Master. 2023-07-24 17:06:31,718 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-24 17:06:31,717 INFO [RS:1;jenkins-hbase4:43483] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 17:06:31,719 DEBUG [RS:1;jenkins-hbase4:43483] regionserver.HRegionServer(1022): About to register with Master. 2023-07-24 17:06:31,722 INFO [RS:1;jenkins-hbase4:43483] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46651,1690218388662 with isa=jenkins-hbase4.apache.org/172.31.14.131:43483, startcode=1690218390174 2023-07-24 17:06:31,724 INFO [RS:2;jenkins-hbase4:37115] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46651,1690218388662 with isa=jenkins-hbase4.apache.org/172.31.14.131:37115, startcode=1690218390225 2023-07-24 17:06:31,724 INFO [RS:0;jenkins-hbase4:44109] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46651,1690218388662 with isa=jenkins-hbase4.apache.org/172.31.14.131:44109, startcode=1690218390103 2023-07-24 17:06:31,759 DEBUG [RS:2;jenkins-hbase4:37115] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-24 17:06:31,761 DEBUG [RS:0;jenkins-hbase4:44109] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-24 17:06:31,759 DEBUG [RS:1;jenkins-hbase4:43483] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-24 17:06:31,830 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45151, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-24 17:06:31,830 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52219, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-24 17:06:31,834 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59687, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-24 17:06:31,838 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-24 17:06:31,841 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46651] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-24 17:06:31,851 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-24 17:06:31,851 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-24 17:06:31,851 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-24 17:06:31,851 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-24 17:06:31,852 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-24 17:06:31,852 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:31,852 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46651] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-24 17:06:31,852 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-24 17:06:31,853 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:31,853 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46651] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-24 17:06:31,877 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1690218421877 2023-07-24 17:06:31,886 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-24 17:06:31,889 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-24 17:06:31,890 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-24 17:06:31,896 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-24 17:06:31,898 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-24 17:06:31,902 DEBUG [RS:0;jenkins-hbase4:44109] regionserver.HRegionServer(2830): Master is not running yet 2023-07-24 17:06:31,903 DEBUG [RS:2;jenkins-hbase4:37115] regionserver.HRegionServer(2830): Master is not running yet 2023-07-24 17:06:31,904 WARN [RS:0;jenkins-hbase4:44109] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-24 17:06:31,902 DEBUG [RS:1;jenkins-hbase4:43483] regionserver.HRegionServer(2830): Master is not running yet 2023-07-24 17:06:31,904 WARN [RS:2;jenkins-hbase4:37115] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-24 17:06:31,905 WARN [RS:1;jenkins-hbase4:43483] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-24 17:06:31,912 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-24 17:06:31,913 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-24 17:06:31,913 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-24 17:06:31,913 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-24 17:06:31,914 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-24 17:06:31,923 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-24 17:06:31,925 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-24 17:06:31,926 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-24 17:06:31,930 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-24 17:06:31,931 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-24 17:06:31,935 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690218391934,5,FailOnTimeoutGroup] 2023-07-24 17:06:31,938 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690218391935,5,FailOnTimeoutGroup] 2023-07-24 17:06:31,939 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-24 17:06:31,944 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-24 17:06:31,945 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-24 17:06:31,946 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-24 17:06:31,978 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-24 17:06:31,979 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-24 17:06:31,980 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d 2023-07-24 17:06:32,008 INFO [RS:2;jenkins-hbase4:37115] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46651,1690218388662 with isa=jenkins-hbase4.apache.org/172.31.14.131:37115, startcode=1690218390225 2023-07-24 17:06:32,008 INFO [RS:0;jenkins-hbase4:44109] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46651,1690218388662 with isa=jenkins-hbase4.apache.org/172.31.14.131:44109, startcode=1690218390103 2023-07-24 17:06:32,008 INFO [RS:1;jenkins-hbase4:43483] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46651,1690218388662 with isa=jenkins-hbase4.apache.org/172.31.14.131:43483, startcode=1690218390174 2023-07-24 17:06:32,025 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46651] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:32,027 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:06:32,030 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-24 17:06:32,033 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46651] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:32,036 DEBUG [RS:0;jenkins-hbase4:44109] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d 2023-07-24 17:06:32,036 DEBUG [RS:0;jenkins-hbase4:44109] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:41733 2023-07-24 17:06:32,036 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46651] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:32,036 DEBUG [RS:2;jenkins-hbase4:37115] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d 2023-07-24 17:06:32,036 DEBUG [RS:0;jenkins-hbase4:44109] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-24 17:06:32,037 DEBUG [RS:2;jenkins-hbase4:37115] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:41733 2023-07-24 17:06:32,037 DEBUG [RS:2;jenkins-hbase4:37115] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-24 17:06:32,039 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/hbase/meta/1588230740/info 2023-07-24 17:06:32,043 DEBUG [RS:1;jenkins-hbase4:43483] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d 2023-07-24 17:06:32,045 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-24 17:06:32,047 DEBUG [RS:1;jenkins-hbase4:43483] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:41733 2023-07-24 17:06:32,050 DEBUG [RS:1;jenkins-hbase4:43483] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-24 17:06:32,050 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 17:06:32,057 DEBUG [RS:0;jenkins-hbase4:44109] zookeeper.ZKUtil(162): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:32,057 WARN [RS:0;jenkins-hbase4:44109] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-24 17:06:32,057 DEBUG [RS:2;jenkins-hbase4:37115] zookeeper.ZKUtil(162): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:32,057 INFO [RS:0;jenkins-hbase4:44109] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 17:06:32,057 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 17:06:32,057 DEBUG [RS:0;jenkins-hbase4:44109] regionserver.HRegionServer(1948): logDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/WALs/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:32,058 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-24 17:06:32,057 WARN [RS:2;jenkins-hbase4:37115] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-24 17:06:32,070 DEBUG [RS:1;jenkins-hbase4:43483] zookeeper.ZKUtil(162): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:32,070 WARN [RS:1;jenkins-hbase4:43483] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-24 17:06:32,070 INFO [RS:1;jenkins-hbase4:43483] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 17:06:32,071 DEBUG [RS:1;jenkins-hbase4:43483] regionserver.HRegionServer(1948): logDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/WALs/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:32,092 INFO [RS:2;jenkins-hbase4:37115] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 17:06:32,101 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/hbase/meta/1588230740/rep_barrier 2023-07-24 17:06:32,105 DEBUG [RS:2;jenkins-hbase4:37115] regionserver.HRegionServer(1948): logDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/WALs/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:32,101 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44109,1690218390103] 2023-07-24 17:06:32,105 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43483,1690218390174] 2023-07-24 17:06:32,105 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37115,1690218390225] 2023-07-24 17:06:32,106 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-24 17:06:32,107 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 17:06:32,107 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-24 17:06:32,115 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/hbase/meta/1588230740/table 2023-07-24 17:06:32,115 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-24 17:06:32,117 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 17:06:32,118 DEBUG [RS:1;jenkins-hbase4:43483] zookeeper.ZKUtil(162): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:32,119 DEBUG [RS:1;jenkins-hbase4:43483] zookeeper.ZKUtil(162): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:32,120 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/hbase/meta/1588230740 2023-07-24 17:06:32,123 DEBUG [RS:2;jenkins-hbase4:37115] zookeeper.ZKUtil(162): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:32,123 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/hbase/meta/1588230740 2023-07-24 17:06:32,123 DEBUG [RS:2;jenkins-hbase4:37115] zookeeper.ZKUtil(162): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:32,124 DEBUG [RS:2;jenkins-hbase4:37115] zookeeper.ZKUtil(162): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:32,126 DEBUG [RS:1;jenkins-hbase4:43483] zookeeper.ZKUtil(162): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:32,131 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-24 17:06:32,134 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-24 17:06:32,135 DEBUG [RS:0;jenkins-hbase4:44109] zookeeper.ZKUtil(162): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:32,136 DEBUG [RS:0;jenkins-hbase4:44109] zookeeper.ZKUtil(162): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:32,136 DEBUG [RS:0;jenkins-hbase4:44109] zookeeper.ZKUtil(162): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:32,138 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 17:06:32,140 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66634776, jitterRate=-0.007064461708068848}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-24 17:06:32,140 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-24 17:06:32,140 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-24 17:06:32,140 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-24 17:06:32,140 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-24 17:06:32,140 DEBUG [RS:0;jenkins-hbase4:44109] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-24 17:06:32,140 DEBUG [RS:2;jenkins-hbase4:37115] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-24 17:06:32,140 DEBUG [RS:1;jenkins-hbase4:43483] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-24 17:06:32,140 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-24 17:06:32,141 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-24 17:06:32,155 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-24 17:06:32,155 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-24 17:06:32,157 INFO [RS:1;jenkins-hbase4:43483] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-24 17:06:32,160 INFO [RS:0;jenkins-hbase4:44109] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-24 17:06:32,162 INFO [RS:2;jenkins-hbase4:37115] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-24 17:06:32,164 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-24 17:06:32,164 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-24 17:06:32,179 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-24 17:06:32,187 INFO [RS:0;jenkins-hbase4:44109] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-24 17:06:32,187 INFO [RS:2;jenkins-hbase4:37115] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-24 17:06:32,187 INFO [RS:1;jenkins-hbase4:43483] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-24 17:06:32,192 INFO [RS:1;jenkins-hbase4:43483] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-24 17:06:32,192 INFO [RS:1;jenkins-hbase4:43483] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 17:06:32,193 INFO [RS:0;jenkins-hbase4:44109] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-24 17:06:32,194 INFO [RS:2;jenkins-hbase4:37115] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-24 17:06:32,195 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-24 17:06:32,195 INFO [RS:1;jenkins-hbase4:43483] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-24 17:06:32,194 INFO [RS:0;jenkins-hbase4:44109] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 17:06:32,195 INFO [RS:2;jenkins-hbase4:37115] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 17:06:32,196 INFO [RS:0;jenkins-hbase4:44109] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-24 17:06:32,200 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-24 17:06:32,202 INFO [RS:2;jenkins-hbase4:37115] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-24 17:06:32,212 INFO [RS:2;jenkins-hbase4:37115] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-24 17:06:32,212 INFO [RS:1;jenkins-hbase4:43483] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-24 17:06:32,212 INFO [RS:0;jenkins-hbase4:44109] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-24 17:06:32,212 DEBUG [RS:2;jenkins-hbase4:37115] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:32,212 DEBUG [RS:0;jenkins-hbase4:44109] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:32,212 DEBUG [RS:1;jenkins-hbase4:43483] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:32,213 DEBUG [RS:0;jenkins-hbase4:44109] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:32,212 DEBUG [RS:2;jenkins-hbase4:37115] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:32,213 DEBUG [RS:0;jenkins-hbase4:44109] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:32,213 DEBUG [RS:2;jenkins-hbase4:37115] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:32,213 DEBUG [RS:0;jenkins-hbase4:44109] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:32,213 DEBUG [RS:2;jenkins-hbase4:37115] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:32,213 DEBUG [RS:0;jenkins-hbase4:44109] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:32,213 DEBUG [RS:2;jenkins-hbase4:37115] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:32,213 DEBUG [RS:0;jenkins-hbase4:44109] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-24 17:06:32,213 DEBUG [RS:2;jenkins-hbase4:37115] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-24 17:06:32,213 DEBUG [RS:1;jenkins-hbase4:43483] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:32,213 DEBUG [RS:2;jenkins-hbase4:37115] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:32,213 DEBUG [RS:0;jenkins-hbase4:44109] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:32,213 DEBUG [RS:1;jenkins-hbase4:43483] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:32,214 DEBUG [RS:0;jenkins-hbase4:44109] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:32,214 DEBUG [RS:1;jenkins-hbase4:43483] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:32,214 DEBUG [RS:0;jenkins-hbase4:44109] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:32,214 DEBUG [RS:1;jenkins-hbase4:43483] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:32,214 DEBUG [RS:0;jenkins-hbase4:44109] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:32,214 DEBUG [RS:1;jenkins-hbase4:43483] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-24 17:06:32,213 DEBUG [RS:2;jenkins-hbase4:37115] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:32,214 DEBUG [RS:1;jenkins-hbase4:43483] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:32,214 DEBUG [RS:2;jenkins-hbase4:37115] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:32,215 DEBUG [RS:1;jenkins-hbase4:43483] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:32,215 DEBUG [RS:2;jenkins-hbase4:37115] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:32,215 DEBUG [RS:1;jenkins-hbase4:43483] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:32,215 INFO [RS:0;jenkins-hbase4:44109] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 17:06:32,215 DEBUG [RS:1;jenkins-hbase4:43483] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:32,215 INFO [RS:0;jenkins-hbase4:44109] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 17:06:32,215 INFO [RS:0;jenkins-hbase4:44109] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-24 17:06:32,221 INFO [RS:2;jenkins-hbase4:37115] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 17:06:32,221 INFO [RS:2;jenkins-hbase4:37115] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 17:06:32,221 INFO [RS:2;jenkins-hbase4:37115] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-24 17:06:32,221 INFO [RS:1;jenkins-hbase4:43483] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 17:06:32,222 INFO [RS:1;jenkins-hbase4:43483] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 17:06:32,222 INFO [RS:1;jenkins-hbase4:43483] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-24 17:06:32,242 INFO [RS:1;jenkins-hbase4:43483] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-24 17:06:32,242 INFO [RS:0;jenkins-hbase4:44109] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-24 17:06:32,256 INFO [RS:1;jenkins-hbase4:43483] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43483,1690218390174-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 17:06:32,258 INFO [RS:2;jenkins-hbase4:37115] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-24 17:06:32,258 INFO [RS:2;jenkins-hbase4:37115] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37115,1690218390225-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 17:06:32,258 INFO [RS:0;jenkins-hbase4:44109] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44109,1690218390103-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 17:06:32,283 INFO [RS:0;jenkins-hbase4:44109] regionserver.Replication(203): jenkins-hbase4.apache.org,44109,1690218390103 started 2023-07-24 17:06:32,283 INFO [RS:0;jenkins-hbase4:44109] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,44109,1690218390103, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44109, sessionid=0x101984c5c040001 2023-07-24 17:06:32,284 INFO [RS:1;jenkins-hbase4:43483] regionserver.Replication(203): jenkins-hbase4.apache.org,43483,1690218390174 started 2023-07-24 17:06:32,284 DEBUG [RS:0;jenkins-hbase4:44109] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-24 17:06:32,284 INFO [RS:1;jenkins-hbase4:43483] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,43483,1690218390174, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43483, sessionid=0x101984c5c040002 2023-07-24 17:06:32,284 DEBUG [RS:0;jenkins-hbase4:44109] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:32,284 DEBUG [RS:1;jenkins-hbase4:43483] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-24 17:06:32,284 DEBUG [RS:0;jenkins-hbase4:44109] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44109,1690218390103' 2023-07-24 17:06:32,285 DEBUG [RS:0;jenkins-hbase4:44109] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-24 17:06:32,286 DEBUG [RS:0;jenkins-hbase4:44109] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-24 17:06:32,286 DEBUG [RS:0;jenkins-hbase4:44109] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-24 17:06:32,284 DEBUG [RS:1;jenkins-hbase4:43483] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:32,287 DEBUG [RS:0;jenkins-hbase4:44109] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-24 17:06:32,287 DEBUG [RS:1;jenkins-hbase4:43483] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43483,1690218390174' 2023-07-24 17:06:32,288 DEBUG [RS:1;jenkins-hbase4:43483] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-24 17:06:32,289 DEBUG [RS:1;jenkins-hbase4:43483] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-24 17:06:32,287 DEBUG [RS:0;jenkins-hbase4:44109] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:32,291 DEBUG [RS:0;jenkins-hbase4:44109] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44109,1690218390103' 2023-07-24 17:06:32,291 DEBUG [RS:0;jenkins-hbase4:44109] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:06:32,293 DEBUG [RS:1;jenkins-hbase4:43483] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-24 17:06:32,293 DEBUG [RS:1;jenkins-hbase4:43483] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-24 17:06:32,294 DEBUG [RS:0;jenkins-hbase4:44109] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:06:32,294 DEBUG [RS:0;jenkins-hbase4:44109] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-24 17:06:32,294 INFO [RS:0;jenkins-hbase4:44109] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-24 17:06:32,294 INFO [RS:0;jenkins-hbase4:44109] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-24 17:06:32,293 DEBUG [RS:1;jenkins-hbase4:43483] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:32,295 DEBUG [RS:1;jenkins-hbase4:43483] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43483,1690218390174' 2023-07-24 17:06:32,296 DEBUG [RS:1;jenkins-hbase4:43483] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:06:32,295 INFO [RS:2;jenkins-hbase4:37115] regionserver.Replication(203): jenkins-hbase4.apache.org,37115,1690218390225 started 2023-07-24 17:06:32,296 INFO [RS:2;jenkins-hbase4:37115] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,37115,1690218390225, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37115, sessionid=0x101984c5c040003 2023-07-24 17:06:32,296 DEBUG [RS:2;jenkins-hbase4:37115] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-24 17:06:32,296 DEBUG [RS:2;jenkins-hbase4:37115] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:32,296 DEBUG [RS:2;jenkins-hbase4:37115] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37115,1690218390225' 2023-07-24 17:06:32,296 DEBUG [RS:2;jenkins-hbase4:37115] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-24 17:06:32,296 DEBUG [RS:1;jenkins-hbase4:43483] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:06:32,296 DEBUG [RS:2;jenkins-hbase4:37115] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-24 17:06:32,296 DEBUG [RS:1;jenkins-hbase4:43483] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-24 17:06:32,297 INFO [RS:1;jenkins-hbase4:43483] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-24 17:06:32,297 INFO [RS:1;jenkins-hbase4:43483] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-24 17:06:32,298 DEBUG [RS:2;jenkins-hbase4:37115] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-24 17:06:32,298 DEBUG [RS:2;jenkins-hbase4:37115] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-24 17:06:32,298 DEBUG [RS:2;jenkins-hbase4:37115] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:32,298 DEBUG [RS:2;jenkins-hbase4:37115] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37115,1690218390225' 2023-07-24 17:06:32,298 DEBUG [RS:2;jenkins-hbase4:37115] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:06:32,299 DEBUG [RS:2;jenkins-hbase4:37115] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:06:32,299 DEBUG [RS:2;jenkins-hbase4:37115] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-24 17:06:32,300 INFO [RS:2;jenkins-hbase4:37115] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-24 17:06:32,300 INFO [RS:2;jenkins-hbase4:37115] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-24 17:06:32,355 DEBUG [jenkins-hbase4:46651] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-24 17:06:32,360 DEBUG [jenkins-hbase4:46651] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 17:06:32,366 DEBUG [jenkins-hbase4:46651] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 17:06:32,366 DEBUG [jenkins-hbase4:46651] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 17:06:32,366 DEBUG [jenkins-hbase4:46651] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 17:06:32,366 DEBUG [jenkins-hbase4:46651] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 17:06:32,370 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,37115,1690218390225, state=OPENING 2023-07-24 17:06:32,380 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-24 17:06:32,382 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 17:06:32,383 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-24 17:06:32,387 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,37115,1690218390225}] 2023-07-24 17:06:32,410 INFO [RS:1;jenkins-hbase4:43483] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43483%2C1690218390174, suffix=, logDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/WALs/jenkins-hbase4.apache.org,43483,1690218390174, archiveDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/oldWALs, maxLogs=32 2023-07-24 17:06:32,412 INFO [RS:2;jenkins-hbase4:37115] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37115%2C1690218390225, suffix=, logDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/WALs/jenkins-hbase4.apache.org,37115,1690218390225, archiveDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/oldWALs, maxLogs=32 2023-07-24 17:06:32,415 INFO [RS:0;jenkins-hbase4:44109] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44109%2C1690218390103, suffix=, logDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/WALs/jenkins-hbase4.apache.org,44109,1690218390103, archiveDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/oldWALs, maxLogs=32 2023-07-24 17:06:32,471 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42393,DS-8d362f52-fcf7-4bda-93bb-4ebe68056178,DISK] 2023-07-24 17:06:32,477 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35227,DS-7f916e9b-3c73-4c42-ad6e-ff15d84ab426,DISK] 2023-07-24 17:06:32,483 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43065,DS-0a7735c5-6cf8-4930-a560-de4955f49346,DISK] 2023-07-24 17:06:32,486 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35227,DS-7f916e9b-3c73-4c42-ad6e-ff15d84ab426,DISK] 2023-07-24 17:06:32,489 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43065,DS-0a7735c5-6cf8-4930-a560-de4955f49346,DISK] 2023-07-24 17:06:32,489 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42393,DS-8d362f52-fcf7-4bda-93bb-4ebe68056178,DISK] 2023-07-24 17:06:32,490 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43065,DS-0a7735c5-6cf8-4930-a560-de4955f49346,DISK] 2023-07-24 17:06:32,490 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42393,DS-8d362f52-fcf7-4bda-93bb-4ebe68056178,DISK] 2023-07-24 17:06:32,490 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35227,DS-7f916e9b-3c73-4c42-ad6e-ff15d84ab426,DISK] 2023-07-24 17:06:32,498 INFO [RS:0;jenkins-hbase4:44109] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/WALs/jenkins-hbase4.apache.org,44109,1690218390103/jenkins-hbase4.apache.org%2C44109%2C1690218390103.1690218392417 2023-07-24 17:06:32,526 INFO [RS:2;jenkins-hbase4:37115] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/WALs/jenkins-hbase4.apache.org,37115,1690218390225/jenkins-hbase4.apache.org%2C37115%2C1690218390225.1690218392415 2023-07-24 17:06:32,530 DEBUG [RS:2;jenkins-hbase4:37115] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42393,DS-8d362f52-fcf7-4bda-93bb-4ebe68056178,DISK], DatanodeInfoWithStorage[127.0.0.1:43065,DS-0a7735c5-6cf8-4930-a560-de4955f49346,DISK], DatanodeInfoWithStorage[127.0.0.1:35227,DS-7f916e9b-3c73-4c42-ad6e-ff15d84ab426,DISK]] 2023-07-24 17:06:32,535 DEBUG [RS:0;jenkins-hbase4:44109] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42393,DS-8d362f52-fcf7-4bda-93bb-4ebe68056178,DISK], DatanodeInfoWithStorage[127.0.0.1:35227,DS-7f916e9b-3c73-4c42-ad6e-ff15d84ab426,DISK], DatanodeInfoWithStorage[127.0.0.1:43065,DS-0a7735c5-6cf8-4930-a560-de4955f49346,DISK]] 2023-07-24 17:06:32,538 INFO [RS:1;jenkins-hbase4:43483] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/WALs/jenkins-hbase4.apache.org,43483,1690218390174/jenkins-hbase4.apache.org%2C43483%2C1690218390174.1690218392419 2023-07-24 17:06:32,542 DEBUG [RS:1;jenkins-hbase4:43483] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43065,DS-0a7735c5-6cf8-4930-a560-de4955f49346,DISK], DatanodeInfoWithStorage[127.0.0.1:35227,DS-7f916e9b-3c73-4c42-ad6e-ff15d84ab426,DISK], DatanodeInfoWithStorage[127.0.0.1:42393,DS-8d362f52-fcf7-4bda-93bb-4ebe68056178,DISK]] 2023-07-24 17:06:32,596 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:32,601 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 17:06:32,604 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41072, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 17:06:32,624 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-24 17:06:32,625 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 17:06:32,637 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37115%2C1690218390225.meta, suffix=.meta, logDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/WALs/jenkins-hbase4.apache.org,37115,1690218390225, archiveDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/oldWALs, maxLogs=32 2023-07-24 17:06:32,677 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42393,DS-8d362f52-fcf7-4bda-93bb-4ebe68056178,DISK] 2023-07-24 17:06:32,683 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35227,DS-7f916e9b-3c73-4c42-ad6e-ff15d84ab426,DISK] 2023-07-24 17:06:32,688 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43065,DS-0a7735c5-6cf8-4930-a560-de4955f49346,DISK] 2023-07-24 17:06:32,708 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/WALs/jenkins-hbase4.apache.org,37115,1690218390225/jenkins-hbase4.apache.org%2C37115%2C1690218390225.meta.1690218392639.meta 2023-07-24 17:06:32,709 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42393,DS-8d362f52-fcf7-4bda-93bb-4ebe68056178,DISK], DatanodeInfoWithStorage[127.0.0.1:35227,DS-7f916e9b-3c73-4c42-ad6e-ff15d84ab426,DISK], DatanodeInfoWithStorage[127.0.0.1:43065,DS-0a7735c5-6cf8-4930-a560-de4955f49346,DISK]] 2023-07-24 17:06:32,710 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-24 17:06:32,711 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-24 17:06:32,713 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 17:06:32,714 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-24 17:06:32,716 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-24 17:06:32,718 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-24 17:06:32,734 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-24 17:06:32,734 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:06:32,734 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-24 17:06:32,734 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-24 17:06:32,738 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-24 17:06:32,741 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/hbase/meta/1588230740/info 2023-07-24 17:06:32,742 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/hbase/meta/1588230740/info 2023-07-24 17:06:32,742 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-24 17:06:32,743 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 17:06:32,744 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-24 17:06:32,745 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/hbase/meta/1588230740/rep_barrier 2023-07-24 17:06:32,745 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/hbase/meta/1588230740/rep_barrier 2023-07-24 17:06:32,746 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-24 17:06:32,748 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 17:06:32,748 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-24 17:06:32,750 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/hbase/meta/1588230740/table 2023-07-24 17:06:32,750 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/hbase/meta/1588230740/table 2023-07-24 17:06:32,750 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-24 17:06:32,751 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 17:06:32,753 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/hbase/meta/1588230740 2023-07-24 17:06:32,756 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/hbase/meta/1588230740 2023-07-24 17:06:32,760 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-24 17:06:32,768 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-24 17:06:32,770 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70046380, jitterRate=0.04377239942550659}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-24 17:06:32,773 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-24 17:06:32,789 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1690218392585 2023-07-24 17:06:32,813 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-24 17:06:32,815 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,37115,1690218390225, state=OPEN 2023-07-24 17:06:32,815 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-24 17:06:32,818 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-24 17:06:32,818 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-24 17:06:32,824 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-24 17:06:32,824 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,37115,1690218390225 in 431 msec 2023-07-24 17:06:32,830 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-24 17:06:32,830 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 646 msec 2023-07-24 17:06:32,836 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.1060 sec 2023-07-24 17:06:32,837 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1690218392837, completionTime=-1 2023-07-24 17:06:32,837 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-24 17:06:32,837 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-24 17:06:32,921 DEBUG [hconnection-0x6b0b3732-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:06:32,926 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41086, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:06:32,955 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-24 17:06:32,955 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1690218452955 2023-07-24 17:06:32,955 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1690218512955 2023-07-24 17:06:32,955 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 117 msec 2023-07-24 17:06:32,987 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46651,1690218388662-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 17:06:32,987 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46651,1690218388662-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-24 17:06:32,988 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46651,1690218388662-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-24 17:06:32,990 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:46651, period=300000, unit=MILLISECONDS is enabled. 2023-07-24 17:06:32,991 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-24 17:06:33,002 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-24 17:06:33,015 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-24 17:06:33,017 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-24 17:06:33,029 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-24 17:06:33,033 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 17:06:33,037 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 17:06:33,060 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/hbase/namespace/d9f6676dfabf50c523bb1e34a000aec8 2023-07-24 17:06:33,063 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/hbase/namespace/d9f6676dfabf50c523bb1e34a000aec8 empty. 2023-07-24 17:06:33,064 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/hbase/namespace/d9f6676dfabf50c523bb1e34a000aec8 2023-07-24 17:06:33,064 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-24 17:06:33,112 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-24 17:06:33,114 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => d9f6676dfabf50c523bb1e34a000aec8, NAME => 'hbase:namespace,,1690218393017.d9f6676dfabf50c523bb1e34a000aec8.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp 2023-07-24 17:06:33,143 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690218393017.d9f6676dfabf50c523bb1e34a000aec8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:06:33,143 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing d9f6676dfabf50c523bb1e34a000aec8, disabling compactions & flushes 2023-07-24 17:06:33,143 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690218393017.d9f6676dfabf50c523bb1e34a000aec8. 2023-07-24 17:06:33,143 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690218393017.d9f6676dfabf50c523bb1e34a000aec8. 2023-07-24 17:06:33,143 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690218393017.d9f6676dfabf50c523bb1e34a000aec8. after waiting 0 ms 2023-07-24 17:06:33,143 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690218393017.d9f6676dfabf50c523bb1e34a000aec8. 2023-07-24 17:06:33,143 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690218393017.d9f6676dfabf50c523bb1e34a000aec8. 2023-07-24 17:06:33,144 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for d9f6676dfabf50c523bb1e34a000aec8: 2023-07-24 17:06:33,160 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 17:06:33,178 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1690218393017.d9f6676dfabf50c523bb1e34a000aec8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690218393164"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218393164"}]},"ts":"1690218393164"} 2023-07-24 17:06:33,224 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-24 17:06:33,227 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 17:06:33,232 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218393227"}]},"ts":"1690218393227"} 2023-07-24 17:06:33,244 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-24 17:06:33,253 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 17:06:33,254 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 17:06:33,254 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 17:06:33,254 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 17:06:33,254 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 17:06:33,257 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d9f6676dfabf50c523bb1e34a000aec8, ASSIGN}] 2023-07-24 17:06:33,260 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d9f6676dfabf50c523bb1e34a000aec8, ASSIGN 2023-07-24 17:06:33,262 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=d9f6676dfabf50c523bb1e34a000aec8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44109,1690218390103; forceNewPlan=false, retain=false 2023-07-24 17:06:33,415 INFO [jenkins-hbase4:46651] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-24 17:06:33,420 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d9f6676dfabf50c523bb1e34a000aec8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:33,421 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1690218393017.d9f6676dfabf50c523bb1e34a000aec8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690218393419"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218393419"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218393419"}]},"ts":"1690218393419"} 2023-07-24 17:06:33,429 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure d9f6676dfabf50c523bb1e34a000aec8, server=jenkins-hbase4.apache.org,44109,1690218390103}] 2023-07-24 17:06:33,584 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:33,584 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 17:06:33,590 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36108, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 17:06:33,598 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1690218393017.d9f6676dfabf50c523bb1e34a000aec8. 2023-07-24 17:06:33,599 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d9f6676dfabf50c523bb1e34a000aec8, NAME => 'hbase:namespace,,1690218393017.d9f6676dfabf50c523bb1e34a000aec8.', STARTKEY => '', ENDKEY => ''} 2023-07-24 17:06:33,599 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1690218393017.d9f6676dfabf50c523bb1e34a000aec8. service=AccessControlService 2023-07-24 17:06:33,600 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 17:06:33,601 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace d9f6676dfabf50c523bb1e34a000aec8 2023-07-24 17:06:33,601 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690218393017.d9f6676dfabf50c523bb1e34a000aec8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:06:33,601 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d9f6676dfabf50c523bb1e34a000aec8 2023-07-24 17:06:33,601 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d9f6676dfabf50c523bb1e34a000aec8 2023-07-24 17:06:33,604 INFO [StoreOpener-d9f6676dfabf50c523bb1e34a000aec8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region d9f6676dfabf50c523bb1e34a000aec8 2023-07-24 17:06:33,608 DEBUG [StoreOpener-d9f6676dfabf50c523bb1e34a000aec8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/hbase/namespace/d9f6676dfabf50c523bb1e34a000aec8/info 2023-07-24 17:06:33,608 DEBUG [StoreOpener-d9f6676dfabf50c523bb1e34a000aec8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/hbase/namespace/d9f6676dfabf50c523bb1e34a000aec8/info 2023-07-24 17:06:33,609 INFO [StoreOpener-d9f6676dfabf50c523bb1e34a000aec8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d9f6676dfabf50c523bb1e34a000aec8 columnFamilyName info 2023-07-24 17:06:33,611 INFO [StoreOpener-d9f6676dfabf50c523bb1e34a000aec8-1] regionserver.HStore(310): Store=d9f6676dfabf50c523bb1e34a000aec8/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 17:06:33,613 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/hbase/namespace/d9f6676dfabf50c523bb1e34a000aec8 2023-07-24 17:06:33,614 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/hbase/namespace/d9f6676dfabf50c523bb1e34a000aec8 2023-07-24 17:06:33,620 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d9f6676dfabf50c523bb1e34a000aec8 2023-07-24 17:06:33,630 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/hbase/namespace/d9f6676dfabf50c523bb1e34a000aec8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 17:06:33,631 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d9f6676dfabf50c523bb1e34a000aec8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60948067, jitterRate=-0.09180302917957306}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 17:06:33,632 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d9f6676dfabf50c523bb1e34a000aec8: 2023-07-24 17:06:33,634 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1690218393017.d9f6676dfabf50c523bb1e34a000aec8., pid=6, masterSystemTime=1690218393584 2023-07-24 17:06:33,639 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1690218393017.d9f6676dfabf50c523bb1e34a000aec8. 2023-07-24 17:06:33,640 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1690218393017.d9f6676dfabf50c523bb1e34a000aec8. 2023-07-24 17:06:33,641 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d9f6676dfabf50c523bb1e34a000aec8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:33,642 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1690218393017.d9f6676dfabf50c523bb1e34a000aec8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690218393641"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690218393641"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690218393641"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690218393641"}]},"ts":"1690218393641"} 2023-07-24 17:06:33,651 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-24 17:06:33,651 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure d9f6676dfabf50c523bb1e34a000aec8, server=jenkins-hbase4.apache.org,44109,1690218390103 in 216 msec 2023-07-24 17:06:33,657 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-24 17:06:33,658 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=d9f6676dfabf50c523bb1e34a000aec8, ASSIGN in 394 msec 2023-07-24 17:06:33,659 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 17:06:33,659 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218393659"}]},"ts":"1690218393659"} 2023-07-24 17:06:33,663 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-24 17:06:33,667 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 17:06:33,670 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 648 msec 2023-07-24 17:06:33,732 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-24 17:06:33,734 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-24 17:06:33,734 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 17:06:33,765 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:06:33,772 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36116, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:06:33,789 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-24 17:06:33,821 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-24 17:06:33,828 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 48 msec 2023-07-24 17:06:33,833 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-24 17:06:33,847 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-24 17:06:33,853 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 19 msec 2023-07-24 17:06:33,860 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-24 17:06:33,865 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-24 17:06:33,865 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.556sec 2023-07-24 17:06:33,869 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-24 17:06:33,871 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-24 17:06:33,871 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-24 17:06:33,873 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46651,1690218388662-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-24 17:06:33,874 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46651,1690218388662-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-24 17:06:33,892 DEBUG [Listener at localhost/37397] zookeeper.ReadOnlyZKClient(139): Connect 0x695cdb1e to 127.0.0.1:49884 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:06:33,900 DEBUG [Listener at localhost/37397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b7ca875, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:06:33,909 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-24 17:06:33,912 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-24 17:06:33,915 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 17:06:33,918 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 17:06:33,920 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-24 17:06:33,922 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/hbase/acl/8e0ac9376dc85844660fd8309fd71da7 2023-07-24 17:06:33,923 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/hbase/acl/8e0ac9376dc85844660fd8309fd71da7 empty. 2023-07-24 17:06:33,923 DEBUG [hconnection-0x5fc26c7c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:06:33,925 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/hbase/acl/8e0ac9376dc85844660fd8309fd71da7 2023-07-24 17:06:33,925 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-24 17:06:33,930 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-24 17:06:33,949 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41090, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:06:33,952 INFO [Listener at localhost/37397] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,46651,1690218388662 2023-07-24 17:06:33,952 INFO [Listener at localhost/37397] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-24 17:06:33,953 INFO [Listener at localhost/37397] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/test.cache.data in system properties and HBase conf 2023-07-24 17:06:33,953 INFO [Listener at localhost/37397] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/hadoop.tmp.dir in system properties and HBase conf 2023-07-24 17:06:33,953 INFO [Listener at localhost/37397] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/hadoop.log.dir in system properties and HBase conf 2023-07-24 17:06:33,953 INFO [Listener at localhost/37397] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-24 17:06:33,953 INFO [Listener at localhost/37397] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-24 17:06:33,953 INFO [Listener at localhost/37397] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-24 17:06:33,953 INFO [Listener at localhost/37397] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-24 17:06:33,954 INFO [Listener at localhost/37397] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-24 17:06:33,954 INFO [Listener at localhost/37397] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-24 17:06:33,954 INFO [Listener at localhost/37397] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-24 17:06:33,954 INFO [Listener at localhost/37397] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-24 17:06:33,954 INFO [Listener at localhost/37397] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-24 17:06:33,954 INFO [Listener at localhost/37397] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-24 17:06:33,954 INFO [Listener at localhost/37397] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-24 17:06:33,955 INFO [Listener at localhost/37397] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-24 17:06:33,955 INFO [Listener at localhost/37397] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/nfs.dump.dir in system properties and HBase conf 2023-07-24 17:06:33,955 INFO [Listener at localhost/37397] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/java.io.tmpdir in system properties and HBase conf 2023-07-24 17:06:33,955 INFO [Listener at localhost/37397] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-24 17:06:33,955 INFO [Listener at localhost/37397] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-24 17:06:33,955 INFO [Listener at localhost/37397] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-24 17:06:33,981 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-24 17:06:33,983 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8e0ac9376dc85844660fd8309fd71da7, NAME => 'hbase:acl,,1690218393900.8e0ac9376dc85844660fd8309fd71da7.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp 2023-07-24 17:06:34,032 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1690218393900.8e0ac9376dc85844660fd8309fd71da7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:06:34,032 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 8e0ac9376dc85844660fd8309fd71da7, disabling compactions & flushes 2023-07-24 17:06:34,032 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1690218393900.8e0ac9376dc85844660fd8309fd71da7. 2023-07-24 17:06:34,032 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1690218393900.8e0ac9376dc85844660fd8309fd71da7. 2023-07-24 17:06:34,032 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1690218393900.8e0ac9376dc85844660fd8309fd71da7. after waiting 0 ms 2023-07-24 17:06:34,033 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1690218393900.8e0ac9376dc85844660fd8309fd71da7. 2023-07-24 17:06:34,033 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1690218393900.8e0ac9376dc85844660fd8309fd71da7. 2023-07-24 17:06:34,033 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 8e0ac9376dc85844660fd8309fd71da7: 2023-07-24 17:06:34,035 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-24 17:06:34,041 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 17:06:34,044 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1690218393900.8e0ac9376dc85844660fd8309fd71da7.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690218394044"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218394044"}]},"ts":"1690218394044"} 2023-07-24 17:06:34,049 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-24 17:06:34,051 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 17:06:34,051 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218394051"}]},"ts":"1690218394051"} 2023-07-24 17:06:34,054 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-24 17:06:34,062 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 17:06:34,064 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 17:06:34,064 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 17:06:34,064 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 17:06:34,064 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 17:06:34,064 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=8e0ac9376dc85844660fd8309fd71da7, ASSIGN}] 2023-07-24 17:06:34,074 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=8e0ac9376dc85844660fd8309fd71da7, ASSIGN 2023-07-24 17:06:34,082 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=8e0ac9376dc85844660fd8309fd71da7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37115,1690218390225; forceNewPlan=false, retain=false 2023-07-24 17:06:34,232 INFO [jenkins-hbase4:46651] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-24 17:06:34,233 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=8e0ac9376dc85844660fd8309fd71da7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:34,234 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1690218393900.8e0ac9376dc85844660fd8309fd71da7.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690218394233"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218394233"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218394233"}]},"ts":"1690218394233"} 2023-07-24 17:06:34,236 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-24 17:06:34,238 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 8e0ac9376dc85844660fd8309fd71da7, server=jenkins-hbase4.apache.org,37115,1690218390225}] 2023-07-24 17:06:34,409 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1690218393900.8e0ac9376dc85844660fd8309fd71da7. 2023-07-24 17:06:34,409 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8e0ac9376dc85844660fd8309fd71da7, NAME => 'hbase:acl,,1690218393900.8e0ac9376dc85844660fd8309fd71da7.', STARTKEY => '', ENDKEY => ''} 2023-07-24 17:06:34,409 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1690218393900.8e0ac9376dc85844660fd8309fd71da7. service=AccessControlService 2023-07-24 17:06:34,410 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 17:06:34,410 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 8e0ac9376dc85844660fd8309fd71da7 2023-07-24 17:06:34,410 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1690218393900.8e0ac9376dc85844660fd8309fd71da7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:06:34,410 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8e0ac9376dc85844660fd8309fd71da7 2023-07-24 17:06:34,410 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8e0ac9376dc85844660fd8309fd71da7 2023-07-24 17:06:34,412 INFO [StoreOpener-8e0ac9376dc85844660fd8309fd71da7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 8e0ac9376dc85844660fd8309fd71da7 2023-07-24 17:06:34,414 DEBUG [StoreOpener-8e0ac9376dc85844660fd8309fd71da7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/hbase/acl/8e0ac9376dc85844660fd8309fd71da7/l 2023-07-24 17:06:34,414 DEBUG [StoreOpener-8e0ac9376dc85844660fd8309fd71da7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/hbase/acl/8e0ac9376dc85844660fd8309fd71da7/l 2023-07-24 17:06:34,415 INFO [StoreOpener-8e0ac9376dc85844660fd8309fd71da7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8e0ac9376dc85844660fd8309fd71da7 columnFamilyName l 2023-07-24 17:06:34,415 INFO [StoreOpener-8e0ac9376dc85844660fd8309fd71da7-1] regionserver.HStore(310): Store=8e0ac9376dc85844660fd8309fd71da7/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 17:06:34,417 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/hbase/acl/8e0ac9376dc85844660fd8309fd71da7 2023-07-24 17:06:34,418 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/hbase/acl/8e0ac9376dc85844660fd8309fd71da7 2023-07-24 17:06:34,423 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8e0ac9376dc85844660fd8309fd71da7 2023-07-24 17:06:34,427 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/hbase/acl/8e0ac9376dc85844660fd8309fd71da7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 17:06:34,428 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8e0ac9376dc85844660fd8309fd71da7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62101143, jitterRate=-0.07462085783481598}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 17:06:34,429 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8e0ac9376dc85844660fd8309fd71da7: 2023-07-24 17:06:34,432 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1690218393900.8e0ac9376dc85844660fd8309fd71da7., pid=11, masterSystemTime=1690218394398 2023-07-24 17:06:34,435 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1690218393900.8e0ac9376dc85844660fd8309fd71da7. 2023-07-24 17:06:34,436 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1690218393900.8e0ac9376dc85844660fd8309fd71da7. 2023-07-24 17:06:34,437 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=8e0ac9376dc85844660fd8309fd71da7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:34,437 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1690218393900.8e0ac9376dc85844660fd8309fd71da7.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690218394436"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690218394436"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690218394436"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690218394436"}]},"ts":"1690218394436"} 2023-07-24 17:06:34,447 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-24 17:06:34,448 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 8e0ac9376dc85844660fd8309fd71da7, server=jenkins-hbase4.apache.org,37115,1690218390225 in 202 msec 2023-07-24 17:06:34,451 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-24 17:06:34,451 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=8e0ac9376dc85844660fd8309fd71da7, ASSIGN in 383 msec 2023-07-24 17:06:34,453 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 17:06:34,453 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218394453"}]},"ts":"1690218394453"} 2023-07-24 17:06:34,456 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-24 17:06:34,460 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 17:06:34,463 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 550 msec 2023-07-24 17:06:34,536 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-24 17:06:34,536 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-24 17:06:34,551 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-24 17:06:35,229 WARN [Thread-384] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 17:06:35,526 INFO [Thread-384] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 17:06:35,537 INFO [Thread-384] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_38201_jobhistory____55hhp3/webapp 2023-07-24 17:06:35,727 INFO [Thread-384] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-24 17:06:35,727 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-24 17:06:35,727 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-24 17:06:35,730 INFO [Thread-384] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-24 17:06:35,801 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 17:06:36,087 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 17:06:36,443 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-24 17:06:36,496 INFO [Thread-384] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:38201 2023-07-24 17:06:36,727 WARN [Listener at jenkins-hbase4.apache.org/44051] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 17:06:37,088 WARN [Listener at jenkins-hbase4.apache.org/44051] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-24 17:06:37,089 INFO [Listener at jenkins-hbase4.apache.org/44051] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 17:06:37,097 INFO [Listener at jenkins-hbase4.apache.org/44051] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_40839_cluster____.ocvj9a/webapp 2023-07-24 17:06:37,178 INFO [Listener at jenkins-hbase4.apache.org/44051] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-24 17:06:37,178 INFO [Listener at jenkins-hbase4.apache.org/44051] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-24 17:06:37,179 INFO [Listener at jenkins-hbase4.apache.org/44051] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-24 17:06:37,179 INFO [Listener at jenkins-hbase4.apache.org/44051] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-24 17:06:37,191 INFO [Listener at jenkins-hbase4.apache.org/44051] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 17:06:37,489 INFO [Listener at jenkins-hbase4.apache.org/44051] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 17:06:37,645 INFO [Listener at jenkins-hbase4.apache.org/44051] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 17:06:37,659 INFO [Listener at jenkins-hbase4.apache.org/44051] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:40839 2023-07-24 17:06:38,394 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 17:06:38,438 WARN [Listener at jenkins-hbase4.apache.org/41869] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 17:06:38,470 WARN [Listener at jenkins-hbase4.apache.org/41869] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-24 17:06:38,471 INFO [Listener at jenkins-hbase4.apache.org/41869] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 17:06:38,492 INFO [Listener at jenkins-hbase4.apache.org/41869] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_34875_node____5fpm4z/webapp 2023-07-24 17:06:38,572 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-24 17:06:38,574 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-24 17:06:38,575 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-24 17:06:38,601 INFO [Listener at jenkins-hbase4.apache.org/41869] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-24 17:06:38,601 INFO [Listener at jenkins-hbase4.apache.org/41869] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-24 17:06:38,602 INFO [Listener at jenkins-hbase4.apache.org/41869] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-24 17:06:38,602 INFO [Listener at jenkins-hbase4.apache.org/41869] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-24 17:06:38,614 INFO [Listener at jenkins-hbase4.apache.org/41869] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 17:06:38,640 INFO [Listener at jenkins-hbase4.apache.org/41869] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 17:06:38,723 INFO [Listener at jenkins-hbase4.apache.org/41869] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 17:06:38,759 INFO [Listener at jenkins-hbase4.apache.org/41869] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:34875 2023-07-24 17:06:38,832 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 17:06:38,833 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-24 17:06:38,833 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 17:06:38,833 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-24 17:06:38,833 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-24 17:06:38,834 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-24 17:06:38,834 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 17:06:38,834 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-24 17:06:38,834 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-24 17:06:38,834 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-24 17:06:39,098 WARN [Listener at jenkins-hbase4.apache.org/34881] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 17:06:39,105 WARN [Listener at jenkins-hbase4.apache.org/34881] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-24 17:06:39,105 INFO [Listener at jenkins-hbase4.apache.org/34881] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 17:06:39,113 INFO [Listener at jenkins-hbase4.apache.org/34881] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_34693_node____.nwkkqb/webapp 2023-07-24 17:06:39,177 INFO [Listener at jenkins-hbase4.apache.org/34881] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-24 17:06:39,177 INFO [Listener at jenkins-hbase4.apache.org/34881] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-24 17:06:39,177 INFO [Listener at jenkins-hbase4.apache.org/34881] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-24 17:06:39,177 INFO [Listener at jenkins-hbase4.apache.org/34881] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-24 17:06:39,185 INFO [Listener at jenkins-hbase4.apache.org/34881] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 17:06:39,203 INFO [Listener at jenkins-hbase4.apache.org/34881] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 17:06:39,302 INFO [Listener at jenkins-hbase4.apache.org/34881] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 17:06:39,314 INFO [Listener at jenkins-hbase4.apache.org/34881] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:34693 2023-07-24 17:06:39,349 INFO [Listener at jenkins-hbase4.apache.org/34881] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-24 17:06:39,351 INFO [Listener at jenkins-hbase4.apache.org/34881] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 17:06:39,450 INFO [Listener at jenkins-hbase4.apache.org/34881] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=707, OpenFileDescriptor=907, MaxFileDescriptor=60000, SystemLoadAverage=174, ProcessCount=174, AvailableMemoryMB=7764 2023-07-24 17:06:39,450 WARN [Listener at jenkins-hbase4.apache.org/34881] hbase.ResourceChecker(130): Thread=707 is superior to 500 2023-07-24 17:06:39,465 DEBUG [Listener at jenkins-hbase4.apache.org/34881] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-24 17:06:39,479 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38644, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-24 17:06:39,485 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-24 17:06:39,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-24 17:06:39,491 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 17:06:39,491 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-24 17:06:39,493 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 17:06:39,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 17:06:39,498 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportWithTargetName/0a0b2cbb74a7fa6960d036cef28ed10e 2023-07-24 17:06:39,498 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportWithTargetName/47f9adc94a55432c650ab151d4dbb3ec 2023-07-24 17:06:39,500 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportWithTargetName/47f9adc94a55432c650ab151d4dbb3ec empty. 2023-07-24 17:06:39,500 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportWithTargetName/0a0b2cbb74a7fa6960d036cef28ed10e empty. 2023-07-24 17:06:39,501 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportWithTargetName/47f9adc94a55432c650ab151d4dbb3ec 2023-07-24 17:06:39,503 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportWithTargetName/0a0b2cbb74a7fa6960d036cef28ed10e 2023-07-24 17:06:39,503 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-24 17:06:39,542 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-24 17:06:39,546 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0a0b2cbb74a7fa6960d036cef28ed10e, NAME => 'testtb-testExportWithTargetName,,1690218399485.0a0b2cbb74a7fa6960d036cef28ed10e.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp 2023-07-24 17:06:39,547 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 47f9adc94a55432c650ab151d4dbb3ec, NAME => 'testtb-testExportWithTargetName,1,1690218399485.47f9adc94a55432c650ab151d4dbb3ec.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp 2023-07-24 17:06:39,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 17:06:39,604 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1690218399485.47f9adc94a55432c650ab151d4dbb3ec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:06:39,604 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1690218399485.0a0b2cbb74a7fa6960d036cef28ed10e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:06:39,606 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 47f9adc94a55432c650ab151d4dbb3ec, disabling compactions & flushes 2023-07-24 17:06:39,606 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 0a0b2cbb74a7fa6960d036cef28ed10e, disabling compactions & flushes 2023-07-24 17:06:39,606 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1690218399485.47f9adc94a55432c650ab151d4dbb3ec. 2023-07-24 17:06:39,606 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1690218399485.0a0b2cbb74a7fa6960d036cef28ed10e. 2023-07-24 17:06:39,606 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1690218399485.47f9adc94a55432c650ab151d4dbb3ec. 2023-07-24 17:06:39,606 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1690218399485.0a0b2cbb74a7fa6960d036cef28ed10e. 2023-07-24 17:06:39,606 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1690218399485.47f9adc94a55432c650ab151d4dbb3ec. after waiting 0 ms 2023-07-24 17:06:39,606 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1690218399485.0a0b2cbb74a7fa6960d036cef28ed10e. after waiting 0 ms 2023-07-24 17:06:39,606 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1690218399485.0a0b2cbb74a7fa6960d036cef28ed10e. 2023-07-24 17:06:39,606 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1690218399485.0a0b2cbb74a7fa6960d036cef28ed10e. 2023-07-24 17:06:39,607 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 0a0b2cbb74a7fa6960d036cef28ed10e: 2023-07-24 17:06:39,606 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1690218399485.47f9adc94a55432c650ab151d4dbb3ec. 2023-07-24 17:06:39,607 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1690218399485.47f9adc94a55432c650ab151d4dbb3ec. 2023-07-24 17:06:39,607 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 47f9adc94a55432c650ab151d4dbb3ec: 2023-07-24 17:06:39,611 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 17:06:39,613 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1690218399485.0a0b2cbb74a7fa6960d036cef28ed10e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690218399613"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218399613"}]},"ts":"1690218399613"} 2023-07-24 17:06:39,614 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1690218399485.47f9adc94a55432c650ab151d4dbb3ec.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690218399613"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218399613"}]},"ts":"1690218399613"} 2023-07-24 17:06:39,678 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 17:06:39,683 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 17:06:39,683 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218399683"}]},"ts":"1690218399683"} 2023-07-24 17:06:39,686 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-24 17:06:39,693 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 17:06:39,695 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 17:06:39,695 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 17:06:39,695 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 17:06:39,695 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 17:06:39,696 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0a0b2cbb74a7fa6960d036cef28ed10e, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=47f9adc94a55432c650ab151d4dbb3ec, ASSIGN}] 2023-07-24 17:06:39,700 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0a0b2cbb74a7fa6960d036cef28ed10e, ASSIGN 2023-07-24 17:06:39,700 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=47f9adc94a55432c650ab151d4dbb3ec, ASSIGN 2023-07-24 17:06:39,701 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0a0b2cbb74a7fa6960d036cef28ed10e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43483,1690218390174; forceNewPlan=false, retain=false 2023-07-24 17:06:39,701 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=47f9adc94a55432c650ab151d4dbb3ec, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44109,1690218390103; forceNewPlan=false, retain=false 2023-07-24 17:06:39,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 17:06:39,855 INFO [jenkins-hbase4:46651] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 17:06:39,857 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=0a0b2cbb74a7fa6960d036cef28ed10e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:39,857 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=47f9adc94a55432c650ab151d4dbb3ec, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:39,858 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1690218399485.0a0b2cbb74a7fa6960d036cef28ed10e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690218399857"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218399857"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218399857"}]},"ts":"1690218399857"} 2023-07-24 17:06:39,858 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1690218399485.47f9adc94a55432c650ab151d4dbb3ec.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690218399857"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218399857"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218399857"}]},"ts":"1690218399857"} 2023-07-24 17:06:39,861 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure 0a0b2cbb74a7fa6960d036cef28ed10e, server=jenkins-hbase4.apache.org,43483,1690218390174}] 2023-07-24 17:06:39,862 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure 47f9adc94a55432c650ab151d4dbb3ec, server=jenkins-hbase4.apache.org,44109,1690218390103}] 2023-07-24 17:06:40,014 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:40,015 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 17:06:40,018 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50480, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 17:06:40,022 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1690218399485.47f9adc94a55432c650ab151d4dbb3ec. 2023-07-24 17:06:40,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 47f9adc94a55432c650ab151d4dbb3ec, NAME => 'testtb-testExportWithTargetName,1,1690218399485.47f9adc94a55432c650ab151d4dbb3ec.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 17:06:40,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1690218399485.47f9adc94a55432c650ab151d4dbb3ec. service=AccessControlService 2023-07-24 17:06:40,023 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 17:06:40,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 47f9adc94a55432c650ab151d4dbb3ec 2023-07-24 17:06:40,024 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1690218399485.47f9adc94a55432c650ab151d4dbb3ec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:06:40,024 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 47f9adc94a55432c650ab151d4dbb3ec 2023-07-24 17:06:40,024 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 47f9adc94a55432c650ab151d4dbb3ec 2023-07-24 17:06:40,024 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1690218399485.0a0b2cbb74a7fa6960d036cef28ed10e. 2023-07-24 17:06:40,024 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0a0b2cbb74a7fa6960d036cef28ed10e, NAME => 'testtb-testExportWithTargetName,,1690218399485.0a0b2cbb74a7fa6960d036cef28ed10e.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 17:06:40,024 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1690218399485.0a0b2cbb74a7fa6960d036cef28ed10e. service=AccessControlService 2023-07-24 17:06:40,025 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 17:06:40,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 0a0b2cbb74a7fa6960d036cef28ed10e 2023-07-24 17:06:40,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1690218399485.0a0b2cbb74a7fa6960d036cef28ed10e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:06:40,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0a0b2cbb74a7fa6960d036cef28ed10e 2023-07-24 17:06:40,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0a0b2cbb74a7fa6960d036cef28ed10e 2023-07-24 17:06:40,026 INFO [StoreOpener-47f9adc94a55432c650ab151d4dbb3ec-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 47f9adc94a55432c650ab151d4dbb3ec 2023-07-24 17:06:40,028 DEBUG [StoreOpener-47f9adc94a55432c650ab151d4dbb3ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportWithTargetName/47f9adc94a55432c650ab151d4dbb3ec/cf 2023-07-24 17:06:40,028 DEBUG [StoreOpener-47f9adc94a55432c650ab151d4dbb3ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportWithTargetName/47f9adc94a55432c650ab151d4dbb3ec/cf 2023-07-24 17:06:40,028 INFO [StoreOpener-47f9adc94a55432c650ab151d4dbb3ec-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 47f9adc94a55432c650ab151d4dbb3ec columnFamilyName cf 2023-07-24 17:06:40,029 INFO [StoreOpener-47f9adc94a55432c650ab151d4dbb3ec-1] regionserver.HStore(310): Store=47f9adc94a55432c650ab151d4dbb3ec/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 17:06:40,031 INFO [StoreOpener-0a0b2cbb74a7fa6960d036cef28ed10e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0a0b2cbb74a7fa6960d036cef28ed10e 2023-07-24 17:06:40,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportWithTargetName/47f9adc94a55432c650ab151d4dbb3ec 2023-07-24 17:06:40,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportWithTargetName/47f9adc94a55432c650ab151d4dbb3ec 2023-07-24 17:06:40,034 DEBUG [StoreOpener-0a0b2cbb74a7fa6960d036cef28ed10e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportWithTargetName/0a0b2cbb74a7fa6960d036cef28ed10e/cf 2023-07-24 17:06:40,034 DEBUG [StoreOpener-0a0b2cbb74a7fa6960d036cef28ed10e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportWithTargetName/0a0b2cbb74a7fa6960d036cef28ed10e/cf 2023-07-24 17:06:40,034 INFO [StoreOpener-0a0b2cbb74a7fa6960d036cef28ed10e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0a0b2cbb74a7fa6960d036cef28ed10e columnFamilyName cf 2023-07-24 17:06:40,035 INFO [StoreOpener-0a0b2cbb74a7fa6960d036cef28ed10e-1] regionserver.HStore(310): Store=0a0b2cbb74a7fa6960d036cef28ed10e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 17:06:40,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportWithTargetName/0a0b2cbb74a7fa6960d036cef28ed10e 2023-07-24 17:06:40,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportWithTargetName/0a0b2cbb74a7fa6960d036cef28ed10e 2023-07-24 17:06:40,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 47f9adc94a55432c650ab151d4dbb3ec 2023-07-24 17:06:40,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0a0b2cbb74a7fa6960d036cef28ed10e 2023-07-24 17:06:40,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportWithTargetName/47f9adc94a55432c650ab151d4dbb3ec/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 17:06:40,049 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 47f9adc94a55432c650ab151d4dbb3ec; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70401201, jitterRate=0.04905964434146881}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 17:06:40,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 47f9adc94a55432c650ab151d4dbb3ec: 2023-07-24 17:06:40,051 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1690218399485.47f9adc94a55432c650ab151d4dbb3ec., pid=16, masterSystemTime=1690218400014 2023-07-24 17:06:40,053 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportWithTargetName/0a0b2cbb74a7fa6960d036cef28ed10e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 17:06:40,054 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0a0b2cbb74a7fa6960d036cef28ed10e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58884221, jitterRate=-0.12255673110485077}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 17:06:40,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0a0b2cbb74a7fa6960d036cef28ed10e: 2023-07-24 17:06:40,055 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1690218399485.47f9adc94a55432c650ab151d4dbb3ec. 2023-07-24 17:06:40,055 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1690218399485.0a0b2cbb74a7fa6960d036cef28ed10e., pid=15, masterSystemTime=1690218400014 2023-07-24 17:06:40,055 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1690218399485.47f9adc94a55432c650ab151d4dbb3ec. 2023-07-24 17:06:40,058 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=47f9adc94a55432c650ab151d4dbb3ec, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:40,059 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1690218399485.47f9adc94a55432c650ab151d4dbb3ec.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690218400058"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690218400058"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690218400058"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690218400058"}]},"ts":"1690218400058"} 2023-07-24 17:06:40,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1690218399485.0a0b2cbb74a7fa6960d036cef28ed10e. 2023-07-24 17:06:40,061 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1690218399485.0a0b2cbb74a7fa6960d036cef28ed10e. 2023-07-24 17:06:40,062 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=0a0b2cbb74a7fa6960d036cef28ed10e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:40,063 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1690218399485.0a0b2cbb74a7fa6960d036cef28ed10e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690218400062"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690218400062"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690218400062"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690218400062"}]},"ts":"1690218400062"} 2023-07-24 17:06:40,068 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=14 2023-07-24 17:06:40,068 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure 47f9adc94a55432c650ab151d4dbb3ec, server=jenkins-hbase4.apache.org,44109,1690218390103 in 201 msec 2023-07-24 17:06:40,070 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=13 2023-07-24 17:06:40,073 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure 0a0b2cbb74a7fa6960d036cef28ed10e, server=jenkins-hbase4.apache.org,43483,1690218390174 in 204 msec 2023-07-24 17:06:40,074 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=47f9adc94a55432c650ab151d4dbb3ec, ASSIGN in 372 msec 2023-07-24 17:06:40,077 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-24 17:06:40,077 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0a0b2cbb74a7fa6960d036cef28ed10e, ASSIGN in 377 msec 2023-07-24 17:06:40,078 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 17:06:40,078 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218400078"}]},"ts":"1690218400078"} 2023-07-24 17:06:40,080 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-24 17:06:40,083 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 17:06:40,088 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-24 17:06:40,107 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37115] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-24 17:06:40,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 17:06:40,147 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-24 17:06:40,147 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-24 17:06:40,148 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-24 17:06:40,147 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-24 17:06:40,148 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 17:06:40,169 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-24 17:06:40,169 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-24 17:06:40,170 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-24 17:06:40,173 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-24 17:06:40,173 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 682 msec 2023-07-24 17:06:40,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 17:06:40,613 INFO [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-24 17:06:40,613 DEBUG [Listener at jenkins-hbase4.apache.org/34881] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportWithTargetName get assigned. Timeout = 60000ms 2023-07-24 17:06:40,614 INFO [Listener at jenkins-hbase4.apache.org/34881] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 17:06:40,619 INFO [Listener at jenkins-hbase4.apache.org/34881] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportWithTargetName assigned to meta. Checking AM states. 2023-07-24 17:06:40,620 INFO [Listener at jenkins-hbase4.apache.org/34881] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 17:06:40,620 INFO [Listener at jenkins-hbase4.apache.org/34881] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportWithTargetName assigned. 2023-07-24 17:06:40,634 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 17:06:40,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690218400634 (current time:1690218400634). 2023-07-24 17:06:40,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 17:06:40,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(139): Connect 0x5c3b5e2e to 127.0.0.1:49884 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:06:40,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7dfe45f1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:06:40,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:06:40,645 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45882, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:06:40,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5c3b5e2e to 127.0.0.1:49884 2023-07-24 17:06:40,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:06:40,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(139): Connect 0x281929a6 to 127.0.0.1:49884 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:06:40,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ef2a1e7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:06:40,656 DEBUG [hconnection-0x57f3c375-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:06:40,657 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45890, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:06:40,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x281929a6 to 127.0.0.1:49884 2023-07-24 17:06:40,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:06:40,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-24 17:06:40,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 17:06:40,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 17:06:40,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 17:06:40,712 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 17:06:40,715 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1690219000715 2023-07-24 17:06:40,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 17:06:40,721 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-24 17:06:40,724 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 17:06:40,729 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 25 msec 2023-07-24 17:06:40,730 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 17:06:40,730 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 17:06:40,731 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 17:06:40,732 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 17:06:40,734 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1690219000734 2023-07-24 17:06:40,786 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,786 INFO [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-24 17:06:40,787 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:06:40,789 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-24 17:06:40,789 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-24 17:06:40,790 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,790 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,796 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:06:40,796 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:06:40,796 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:06:40,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:06:40,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:06:40,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:06:40,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:06:40,796 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:40,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:06:40,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:06:40,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,797 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:40,797 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:40,797 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,797 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,797 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,797 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:40,797 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 17:06:40,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-24 17:06:40,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-24 17:06:40,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-24 17:06:40,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,799 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 17:06:40,799 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 17:06:40,799 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 17:06:40,802 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,803 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,803 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,807 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 17:06:40,807 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:06:40,807 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 17:06:40,807 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:06:40,809 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 17:06:40,809 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 17:06:40,809 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-24 17:06:40,809 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 17:06:40,809 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-24 17:06:40,809 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:06:40,809 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37115,1690218390225' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-24 17:06:40,809 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44109,1690218390103' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-24 17:06:40,814 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 17:06:40,814 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-24 17:06:40,814 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43483,1690218390174' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-24 17:06:40,816 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,816 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,816 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:40,817 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,817 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:06:40,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:40,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:06:40,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:06:40,819 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:40,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:06:40,820 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,820 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:06:40,820 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:06:40,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:40,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:40,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:40,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:06:40,823 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,824 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:06:40,824 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44109,1690218390103' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-24 17:06:40,824 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6cfb0a57[Count = 1] remaining members to acquire global barrier 2023-07-24 17:06:40,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:40,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:06:40,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:06:40,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:06:40,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:06:40,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:40,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:40,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:40,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:06:40,827 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43483,1690218390174' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-24 17:06:40,827 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6cfb0a57[Count = 0] remaining members to acquire global barrier 2023-07-24 17:06:40,827 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-24 17:06:40,828 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,830 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,830 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,830 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,830 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:06:40,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,830 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:40,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,831 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 17:06:40,831 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 17:06:40,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,831 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-24 17:06:40,831 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37115,1690218390225' in zk 2023-07-24 17:06:40,831 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 17:06:40,831 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:40,831 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 17:06:40,832 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 17:06:40,832 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 17:06:40,832 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1690218399485.47f9adc94a55432c650ab151d4dbb3ec. 2023-07-24 17:06:40,832 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 17:06:40,832 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 17:06:40,832 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1690218399485.0a0b2cbb74a7fa6960d036cef28ed10e. 2023-07-24 17:06:40,833 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1690218399485.47f9adc94a55432c650ab151d4dbb3ec. started... 2023-07-24 17:06:40,833 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1690218399485.0a0b2cbb74a7fa6960d036cef28ed10e. started... 2023-07-24 17:06:40,834 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 17:06:40,834 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:06:40,834 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-24 17:06:40,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 17:06:40,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-24 17:06:40,841 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 17:06:40,843 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 47f9adc94a55432c650ab151d4dbb3ec: 2023-07-24 17:06:40,843 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0a0b2cbb74a7fa6960d036cef28ed10e: 2023-07-24 17:06:40,844 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1690218399485.47f9adc94a55432c650ab151d4dbb3ec.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,844 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1690218399485.0a0b2cbb74a7fa6960d036cef28ed10e.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,849 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 17:06:40,849 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 17:06:40,856 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 17:06:40,856 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 17:06:40,937 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1690218399485.47f9adc94a55432c650ab151d4dbb3ec. completed. 2023-07-24 17:06:40,937 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1690218399485.47f9adc94a55432c650ab151d4dbb3ec. 2023-07-24 17:06:40,937 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1690218399485.0a0b2cbb74a7fa6960d036cef28ed10e. completed. 2023-07-24 17:06:40,937 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1690218399485.0a0b2cbb74a7fa6960d036cef28ed10e. 2023-07-24 17:06:40,938 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 17:06:40,938 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 17:06:40,938 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:40,938 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-24 17:06:40,938 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,44109,1690218390103' in zk 2023-07-24 17:06:40,938 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 17:06:40,938 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 17:06:40,938 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:40,938 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-24 17:06:40,938 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43483,1690218390174' in zk 2023-07-24 17:06:40,941 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:40,941 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 17:06:40,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:40,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:06:40,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:06:40,941 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:06:40,941 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-24 17:06:40,943 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:40,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:06:40,943 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 17:06:40,943 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:06:40,943 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-24 17:06:40,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:06:40,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:40,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:40,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:40,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:06:40,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:40,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:40,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:40,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,44109,1690218390103': 2023-07-24 17:06:40,950 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44109,1690218390103' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-24 17:06:40,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:40,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:06:40,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:06:40,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:06:40,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:06:40,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:40,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:40,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:40,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:06:40,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:40,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:40,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:40,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,43483,1690218390174': 2023-07-24 17:06:40,956 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43483,1690218390174' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-24 17:06:40,956 INFO [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-24 17:06:40,956 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 17:06:40,956 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 17:06:40,956 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,956 INFO [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 17:06:40,960 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,960 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,960 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,960 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:06:40,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,960 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:06:40,960 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:06:40,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:06:40,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:06:40,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:06:40,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:06:40,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,962 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:06:40,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:06:40,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:06:40,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:06:40,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:06:40,965 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:40,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,965 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:40,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:06:40,966 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:40,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:40,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:40,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:40,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:06:40,968 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:40,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,968 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:40,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:40,969 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:40,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:40,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:40,983 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:06:40,983 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:06:40,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:06:40,983 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:06:40,983 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:06:40,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:06:40,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:06:40,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:06:40,983 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:06:40,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:06:40,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:06:40,984 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:40,984 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,984 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:40,984 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:40,984 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,984 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:40,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:06:40,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:06:40,984 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:06:40,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:06:40,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:06:40,984 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,985 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:40,985 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:40,985 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,985 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:06:40,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:06:40,989 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:06:40,990 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,991 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,994 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,041 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:06:41,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 17:06:41,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-24 17:06:41,044 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 17:06:41,049 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,129 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-24 17:06:41,129 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,130 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,130 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1690218400721Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1690218400991 (+270 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1690218400991Writing data manifest for emptySnaptb0-testExportWithTargetName at 1690218401007 (+16 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1690218401034 (+27 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1690218401129 (+95 ms) 2023-07-24 17:06:41,132 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 17:06:41,134 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 403 msec 2023-07-24 17:06:41,344 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:06:41,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 17:06:41,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 17:06:41,369 DEBUG [htable-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:06:41,369 DEBUG [htable-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:06:41,375 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51202, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:06:41,376 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39416, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:06:41,378 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43483] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1690218399485.0a0b2cbb74a7fa6960d036cef28ed10e. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 17:06:41,378 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44109] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1690218399485.47f9adc94a55432c650ab151d4dbb3ec. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 17:06:41,385 DEBUG [Listener at jenkins-hbase4.apache.org/34881] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-24 17:06:41,386 DEBUG [Listener at jenkins-hbase4.apache.org/34881] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1690218399485.0a0b2cbb74a7fa6960d036cef28ed10e. 2023-07-24 17:06:41,389 INFO [Listener at jenkins-hbase4.apache.org/34881] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 17:06:41,426 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 17:06:41,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690218401426 (current time:1690218401426). 2023-07-24 17:06:41,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 17:06:41,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(139): Connect 0x7595e8c6 to 127.0.0.1:49884 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:06:41,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@79e48662, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:06:41,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:06:41,436 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45896, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:06:41,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7595e8c6 to 127.0.0.1:49884 2023-07-24 17:06:41,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:06:41,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(139): Connect 0x4251ce9e to 127.0.0.1:49884 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:06:41,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18d8cdca, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:06:41,444 DEBUG [hconnection-0x45528f25-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:06:41,447 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45906, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:06:41,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4251ce9e to 127.0.0.1:49884 2023-07-24 17:06:41,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:06:41,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-24 17:06:41,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 17:06:41,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 17:06:41,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 17:06:41,457 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 17:06:41,458 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1690219001458 2023-07-24 17:06:41,458 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-24 17:06:41,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 17:06:41,459 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 17:06:41,459 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 17:06:41,460 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 17:06:41,460 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 17:06:41,462 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 6 msec 2023-07-24 17:06:41,463 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 17:06:41,464 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1690219001464 2023-07-24 17:06:41,479 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-24 17:06:41,479 INFO [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-24 17:06:41,479 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:06:41,480 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-24 17:06:41,480 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-24 17:06:41,480 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,480 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,482 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:06:41,482 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:41,482 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:06:41,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:06:41,482 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:06:41,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:06:41,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:06:41,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:06:41,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:06:41,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:06:41,483 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:41,483 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:41,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,483 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:41,483 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 17:06:41,484 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,484 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,484 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-24 17:06:41,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-24 17:06:41,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-24 17:06:41,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,484 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 17:06:41,484 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 17:06:41,484 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 17:06:41,485 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-24 17:06:41,485 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-24 17:06:41,485 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 17:06:41,485 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:06:41,485 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-24 17:06:41,486 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 17:06:41,486 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 17:06:41,486 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:06:41,485 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 17:06:41,487 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 17:06:41,487 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-24 17:06:41,486 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-24 17:06:41,487 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44109,1690218390103' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-24 17:06:41,487 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:06:41,487 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37115,1690218390225' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-24 17:06:41,487 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 17:06:41,487 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-24 17:06:41,488 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43483,1690218390174' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-24 17:06:41,490 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:41,490 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:41,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:06:41,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:06:41,491 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,492 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:06:41,492 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,491 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:41,492 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:06:41,492 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,492 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:06:41,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:06:41,492 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,492 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:06:41,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 17:06:41,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:41,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:41,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:41,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:06:41,494 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44109,1690218390103' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-24 17:06:41,494 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d5c126a[Count = 1] remaining members to acquire global barrier 2023-07-24 17:06:41,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:41,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:06:41,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:06:41,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:06:41,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:06:41,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 17:06:41,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:41,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:41,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:41,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:06:41,497 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43483,1690218390174' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-24 17:06:41,497 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d5c126a[Count = 0] remaining members to acquire global barrier 2023-07-24 17:06:41,497 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-24 17:06:41,497 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,502 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,502 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,502 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,502 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 17:06:41,503 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 17:06:41,502 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:41,503 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-24 17:06:41,503 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 17:06:41,503 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 17:06:41,503 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1690218399485.47f9adc94a55432c650ab151d4dbb3ec. 2023-07-24 17:06:41,502 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 17:06:41,503 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1690218399485.47f9adc94a55432c650ab151d4dbb3ec. started... 2023-07-24 17:06:41,503 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37115,1690218390225' in zk 2023-07-24 17:06:41,503 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 17:06:41,503 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 17:06:41,503 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:41,503 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 17:06:41,503 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1690218399485.0a0b2cbb74a7fa6960d036cef28ed10e. 2023-07-24 17:06:41,503 INFO [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 47f9adc94a55432c650ab151d4dbb3ec 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-24 17:06:41,503 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1690218399485.0a0b2cbb74a7fa6960d036cef28ed10e. started... 2023-07-24 17:06:41,503 INFO [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0a0b2cbb74a7fa6960d036cef28ed10e 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-24 17:06:41,505 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 17:06:41,505 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:06:41,505 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-24 17:06:41,560 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:06:41,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 17:06:41,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-24 17:06:41,563 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 17:06:41,606 INFO [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportWithTargetName/47f9adc94a55432c650ab151d4dbb3ec/.tmp/cf/e08dde25d600491c9dffb9b7cad0087f 2023-07-24 17:06:41,609 INFO [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportWithTargetName/0a0b2cbb74a7fa6960d036cef28ed10e/.tmp/cf/80c2c4d508084aed8dfbb6ff97b6d041 2023-07-24 17:06:41,665 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportWithTargetName/0a0b2cbb74a7fa6960d036cef28ed10e/.tmp/cf/80c2c4d508084aed8dfbb6ff97b6d041 as hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportWithTargetName/0a0b2cbb74a7fa6960d036cef28ed10e/cf/80c2c4d508084aed8dfbb6ff97b6d041 2023-07-24 17:06:41,665 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportWithTargetName/47f9adc94a55432c650ab151d4dbb3ec/.tmp/cf/e08dde25d600491c9dffb9b7cad0087f as hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportWithTargetName/47f9adc94a55432c650ab151d4dbb3ec/cf/e08dde25d600491c9dffb9b7cad0087f 2023-07-24 17:06:41,675 INFO [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportWithTargetName/0a0b2cbb74a7fa6960d036cef28ed10e/cf/80c2c4d508084aed8dfbb6ff97b6d041, entries=3, sequenceid=6, filesize=5.0 K 2023-07-24 17:06:41,676 INFO [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportWithTargetName/47f9adc94a55432c650ab151d4dbb3ec/cf/e08dde25d600491c9dffb9b7cad0087f, entries=47, sequenceid=6, filesize=8.0 K 2023-07-24 17:06:41,681 INFO [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 0a0b2cbb74a7fa6960d036cef28ed10e in 178ms, sequenceid=6, compaction requested=false 2023-07-24 17:06:41,681 INFO [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 47f9adc94a55432c650ab151d4dbb3ec in 178ms, sequenceid=6, compaction requested=false 2023-07-24 17:06:41,681 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-24 17:06:41,681 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-24 17:06:41,684 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0a0b2cbb74a7fa6960d036cef28ed10e: 2023-07-24 17:06:41,684 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 47f9adc94a55432c650ab151d4dbb3ec: 2023-07-24 17:06:41,684 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1690218399485.0a0b2cbb74a7fa6960d036cef28ed10e.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-24 17:06:41,684 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 17:06:41,684 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1690218399485.47f9adc94a55432c650ab151d4dbb3ec.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-24 17:06:41,684 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportWithTargetName/0a0b2cbb74a7fa6960d036cef28ed10e/cf/80c2c4d508084aed8dfbb6ff97b6d041] hfiles 2023-07-24 17:06:41,684 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 17:06:41,684 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportWithTargetName/0a0b2cbb74a7fa6960d036cef28ed10e/cf/80c2c4d508084aed8dfbb6ff97b6d041 for snapshot=snaptb0-testExportWithTargetName 2023-07-24 17:06:41,684 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportWithTargetName/47f9adc94a55432c650ab151d4dbb3ec/cf/e08dde25d600491c9dffb9b7cad0087f] hfiles 2023-07-24 17:06:41,685 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportWithTargetName/47f9adc94a55432c650ab151d4dbb3ec/cf/e08dde25d600491c9dffb9b7cad0087f for snapshot=snaptb0-testExportWithTargetName 2023-07-24 17:06:41,725 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1690218399485.0a0b2cbb74a7fa6960d036cef28ed10e. completed. 2023-07-24 17:06:41,725 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1690218399485.0a0b2cbb74a7fa6960d036cef28ed10e. 2023-07-24 17:06:41,725 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 17:06:41,725 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 17:06:41,725 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:41,725 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-24 17:06:41,725 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43483,1690218390174' in zk 2023-07-24 17:06:41,727 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:41,728 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1690218399485.47f9adc94a55432c650ab151d4dbb3ec. completed. 2023-07-24 17:06:41,728 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 17:06:41,728 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1690218399485.47f9adc94a55432c650ab151d4dbb3ec. 2023-07-24 17:06:41,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:41,728 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 17:06:41,728 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 17:06:41,728 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:41,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:06:41,728 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:06:41,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:06:41,728 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-24 17:06:41,729 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,44109,1690218390103' in zk 2023-07-24 17:06:41,728 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-24 17:06:41,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:06:41,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:06:41,732 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 17:06:41,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 17:06:41,732 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:06:41,732 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-24 17:06:41,732 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:41,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:41,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:41,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:41,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:06:41,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 17:06:41,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:41,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:41,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:41,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,43483,1690218390174': 2023-07-24 17:06:41,742 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43483,1690218390174' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-24 17:06:41,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:41,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:06:41,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:06:41,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:06:41,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:06:41,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 17:06:41,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:41,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:41,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:41,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:06:41,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 17:06:41,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:41,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:41,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:41,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,44109,1690218390103': 2023-07-24 17:06:41,750 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44109,1690218390103' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-24 17:06:41,750 INFO [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-24 17:06:41,750 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 17:06:41,750 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 17:06:41,750 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-24 17:06:41,750 INFO [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 17:06:41,754 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,754 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,754 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:06:41,754 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:06:41,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,754 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,754 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:06:41,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:06:41,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:06:41,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:06:41,754 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:06:41,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:06:41,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:06:41,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:06:41,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:06:41,756 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:41,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:06:41,757 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:41,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 17:06:41,757 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:41,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:06:41,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 17:06:41,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:41,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:41,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:41,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:06:41,761 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:41,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 17:06:41,762 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:41,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:41,763 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:41,763 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:06:41,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 17:06:41,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-24 17:06:41,765 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 17:06:41,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:41,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:41,783 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:06:41,784 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:06:41,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:06:41,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:06:41,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:06:41,784 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:06:41,784 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:06:41,784 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:06:41,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:06:41,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:06:41,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:06:41,784 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:06:41,784 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:06:41,784 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:41,786 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,786 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:41,786 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:41,786 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,786 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:41,786 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,786 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:41,787 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:41,787 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,787 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:06:41,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:06:41,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:06:41,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:06:41,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:06:41,784 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-24 17:06:41,787 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-24 17:06:41,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:06:41,788 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,831 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-24 17:06:42,065 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:06:42,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 17:06:42,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-24 17:06:42,067 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-24 17:06:42,274 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-24 17:06:42,274 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-24 17:06:42,274 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-24 17:06:42,275 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1690218401458Consolidate snapshot: snaptb0-testExportWithTargetName at 1690218401787 (+329 ms)Loading Region manifests for snaptb0-testExportWithTargetName at 1690218401787Writing data manifest for snaptb0-testExportWithTargetName at 1690218401799 (+12 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1690218401821 (+22 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1690218402274 (+453 ms) 2023-07-24 17:06:42,278 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 17:06:42,281 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 819 msec 2023-07-24 17:06:42,568 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:06:42,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 17:06:42,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 17:06:42,572 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/export-test/export-1690218402572 2023-07-24 17:06:42,572 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:41733, tgtDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/export-test/export-1690218402572, rawTgtDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/export-test/export-1690218402572, srcFsUri=hdfs://localhost:41733, srcDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d 2023-07-24 17:06:42,617 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:41733, inputRoot=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d 2023-07-24 17:06:42,617 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-593237214_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/export-test/export-1690218402572, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/export-test/export-1690218402572/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-24 17:06:42,617 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:41733, inputRoot=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d, snapshotDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-24 17:06:42,635 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/export-test/export-1690218402572/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-24 17:06:42,707 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 17:06:42,708 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 17:06:42,709 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 17:06:42,709 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 17:06:42,710 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-24 17:06:42,711 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 17:06:42,711 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 17:06:42,802 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/hadoop-98331107942916796.jar 2023-07-24 17:06:42,803 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 17:06:42,804 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 17:06:42,804 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 17:06:42,805 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 17:06:42,805 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 17:06:42,806 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 17:06:42,807 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 17:06:42,807 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 17:06:42,808 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 17:06:42,808 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 17:06:42,809 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 17:06:42,809 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 17:06:42,810 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 17:06:42,811 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 17:06:42,811 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 17:06:42,812 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 17:06:42,816 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 17:06:42,817 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 17:06:42,817 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 17:06:42,817 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 17:06:42,818 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 17:06:42,818 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 17:06:42,819 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 17:06:43,898 WARN [Listener at jenkins-hbase4.apache.org/34881] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 17:06:43,909 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-24 17:06:43,921 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-24 17:06:44,446 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 17:06:44,448 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 17:06:45,129 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397910_0001_000001 (auth:SIMPLE) 2023-07-24 17:06:45,532 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 17:06:50,784 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397910_0001_000001 (auth:SIMPLE) 2023-07-24 17:06:53,070 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397910_0001_000001 (auth:SIMPLE) 2023-07-24 17:06:56,258 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397910_0001_000001 (auth:SIMPLE) 2023-07-24 17:06:57,855 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 17:06:57,860 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 17:06:57,872 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-24 17:06:57,873 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 17:06:57,873 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 17:06:57,873 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-789691247_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-24 17:06:57,874 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(367): hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-24 17:06:57,874 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(367): hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-24 17:06:57,874 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-789691247_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/export-test/export-1690218402572/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/export-test/export-1690218402572/.hbase-snapshot/testExportWithTargetName 2023-07-24 17:06:57,875 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(367): hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/export-test/export-1690218402572/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-24 17:06:57,875 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(367): hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/export-test/export-1690218402572/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-24 17:06:57,886 INFO [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-24 17:06:57,891 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-24 17:06:57,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-24 17:06:57,907 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218417906"}]},"ts":"1690218417906"} 2023-07-24 17:06:57,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-24 17:06:57,909 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-24 17:06:57,910 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-24 17:06:57,912 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0a0b2cbb74a7fa6960d036cef28ed10e, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=47f9adc94a55432c650ab151d4dbb3ec, UNASSIGN}] 2023-07-24 17:06:57,915 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0a0b2cbb74a7fa6960d036cef28ed10e, UNASSIGN 2023-07-24 17:06:57,915 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=47f9adc94a55432c650ab151d4dbb3ec, UNASSIGN 2023-07-24 17:06:57,923 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=0a0b2cbb74a7fa6960d036cef28ed10e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:57,923 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=47f9adc94a55432c650ab151d4dbb3ec, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:57,923 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1690218399485.0a0b2cbb74a7fa6960d036cef28ed10e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690218417923"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218417923"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218417923"}]},"ts":"1690218417923"} 2023-07-24 17:06:57,923 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1690218399485.47f9adc94a55432c650ab151d4dbb3ec.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690218417923"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218417923"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218417923"}]},"ts":"1690218417923"} 2023-07-24 17:06:57,927 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 0a0b2cbb74a7fa6960d036cef28ed10e, server=jenkins-hbase4.apache.org,43483,1690218390174}] 2023-07-24 17:06:57,929 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 47f9adc94a55432c650ab151d4dbb3ec, server=jenkins-hbase4.apache.org,44109,1690218390103}] 2023-07-24 17:06:58,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-24 17:06:58,088 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0a0b2cbb74a7fa6960d036cef28ed10e 2023-07-24 17:06:58,088 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 47f9adc94a55432c650ab151d4dbb3ec 2023-07-24 17:06:58,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0a0b2cbb74a7fa6960d036cef28ed10e, disabling compactions & flushes 2023-07-24 17:06:58,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 47f9adc94a55432c650ab151d4dbb3ec, disabling compactions & flushes 2023-07-24 17:06:58,089 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1690218399485.0a0b2cbb74a7fa6960d036cef28ed10e. 2023-07-24 17:06:58,089 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1690218399485.47f9adc94a55432c650ab151d4dbb3ec. 2023-07-24 17:06:58,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1690218399485.0a0b2cbb74a7fa6960d036cef28ed10e. 2023-07-24 17:06:58,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1690218399485.47f9adc94a55432c650ab151d4dbb3ec. 2023-07-24 17:06:58,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1690218399485.0a0b2cbb74a7fa6960d036cef28ed10e. after waiting 0 ms 2023-07-24 17:06:58,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1690218399485.47f9adc94a55432c650ab151d4dbb3ec. after waiting 0 ms 2023-07-24 17:06:58,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1690218399485.0a0b2cbb74a7fa6960d036cef28ed10e. 2023-07-24 17:06:58,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1690218399485.47f9adc94a55432c650ab151d4dbb3ec. 2023-07-24 17:06:58,103 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportWithTargetName/47f9adc94a55432c650ab151d4dbb3ec/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 17:06:58,104 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportWithTargetName/0a0b2cbb74a7fa6960d036cef28ed10e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 17:06:58,104 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 17:06:58,104 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 17:06:58,106 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1690218399485.47f9adc94a55432c650ab151d4dbb3ec. 2023-07-24 17:06:58,106 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1690218399485.0a0b2cbb74a7fa6960d036cef28ed10e. 2023-07-24 17:06:58,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 47f9adc94a55432c650ab151d4dbb3ec: 2023-07-24 17:06:58,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0a0b2cbb74a7fa6960d036cef28ed10e: 2023-07-24 17:06:58,108 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0a0b2cbb74a7fa6960d036cef28ed10e 2023-07-24 17:06:58,109 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=0a0b2cbb74a7fa6960d036cef28ed10e, regionState=CLOSED 2023-07-24 17:06:58,109 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1690218399485.0a0b2cbb74a7fa6960d036cef28ed10e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690218418109"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218418109"}]},"ts":"1690218418109"} 2023-07-24 17:06:58,109 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 47f9adc94a55432c650ab151d4dbb3ec 2023-07-24 17:06:58,109 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=47f9adc94a55432c650ab151d4dbb3ec, regionState=CLOSED 2023-07-24 17:06:58,110 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1690218399485.47f9adc94a55432c650ab151d4dbb3ec.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690218418109"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218418109"}]},"ts":"1690218418109"} 2023-07-24 17:06:58,113 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-24 17:06:58,113 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 0a0b2cbb74a7fa6960d036cef28ed10e, server=jenkins-hbase4.apache.org,43483,1690218390174 in 185 msec 2023-07-24 17:06:58,114 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-24 17:06:58,114 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 47f9adc94a55432c650ab151d4dbb3ec, server=jenkins-hbase4.apache.org,44109,1690218390103 in 183 msec 2023-07-24 17:06:58,115 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0a0b2cbb74a7fa6960d036cef28ed10e, UNASSIGN in 201 msec 2023-07-24 17:06:58,117 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=21 2023-07-24 17:06:58,117 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=47f9adc94a55432c650ab151d4dbb3ec, UNASSIGN in 202 msec 2023-07-24 17:06:58,118 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218418118"}]},"ts":"1690218418118"} 2023-07-24 17:06:58,120 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-24 17:06:58,121 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-24 17:06:58,125 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 228 msec 2023-07-24 17:06:58,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-24 17:06:58,211 INFO [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-24 17:06:58,215 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-24 17:06:58,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 17:06:58,225 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 17:06:58,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-24 17:06:58,227 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 17:06:58,230 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37115] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-24 17:06:58,233 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportWithTargetName/0a0b2cbb74a7fa6960d036cef28ed10e 2023-07-24 17:06:58,233 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportWithTargetName/47f9adc94a55432c650ab151d4dbb3ec 2023-07-24 17:06:58,233 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 17:06:58,233 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 17:06:58,233 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 17:06:58,233 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 17:06:58,234 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:06:58,234 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:06:58,235 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-24 17:06:58,235 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 17:06:58,235 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:06:58,235 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-24 17:06:58,235 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 17:06:58,235 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:06:58,235 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-24 17:06:58,235 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-24 17:06:58,235 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 17:06:58,235 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 17:06:58,237 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportWithTargetName/47f9adc94a55432c650ab151d4dbb3ec/cf, FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportWithTargetName/47f9adc94a55432c650ab151d4dbb3ec/recovered.edits] 2023-07-24 17:06:58,237 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportWithTargetName/0a0b2cbb74a7fa6960d036cef28ed10e/cf, FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportWithTargetName/0a0b2cbb74a7fa6960d036cef28ed10e/recovered.edits] 2023-07-24 17:06:58,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-24 17:06:58,245 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportWithTargetName/47f9adc94a55432c650ab151d4dbb3ec/cf/e08dde25d600491c9dffb9b7cad0087f to hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/archive/data/default/testtb-testExportWithTargetName/47f9adc94a55432c650ab151d4dbb3ec/cf/e08dde25d600491c9dffb9b7cad0087f 2023-07-24 17:06:58,245 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportWithTargetName/0a0b2cbb74a7fa6960d036cef28ed10e/cf/80c2c4d508084aed8dfbb6ff97b6d041 to hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/archive/data/default/testtb-testExportWithTargetName/0a0b2cbb74a7fa6960d036cef28ed10e/cf/80c2c4d508084aed8dfbb6ff97b6d041 2023-07-24 17:06:58,249 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportWithTargetName/47f9adc94a55432c650ab151d4dbb3ec/recovered.edits/9.seqid to hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/archive/data/default/testtb-testExportWithTargetName/47f9adc94a55432c650ab151d4dbb3ec/recovered.edits/9.seqid 2023-07-24 17:06:58,249 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportWithTargetName/0a0b2cbb74a7fa6960d036cef28ed10e/recovered.edits/9.seqid to hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/archive/data/default/testtb-testExportWithTargetName/0a0b2cbb74a7fa6960d036cef28ed10e/recovered.edits/9.seqid 2023-07-24 17:06:58,250 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportWithTargetName/47f9adc94a55432c650ab151d4dbb3ec 2023-07-24 17:06:58,250 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportWithTargetName/0a0b2cbb74a7fa6960d036cef28ed10e 2023-07-24 17:06:58,250 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-24 17:06:58,253 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 17:06:58,276 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-24 17:06:58,282 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-24 17:06:58,285 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 17:06:58,285 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-24 17:06:58,285 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1690218399485.0a0b2cbb74a7fa6960d036cef28ed10e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690218418285"}]},"ts":"9223372036854775807"} 2023-07-24 17:06:58,285 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1690218399485.47f9adc94a55432c650ab151d4dbb3ec.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690218418285"}]},"ts":"9223372036854775807"} 2023-07-24 17:06:58,289 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 17:06:58,289 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0a0b2cbb74a7fa6960d036cef28ed10e, NAME => 'testtb-testExportWithTargetName,,1690218399485.0a0b2cbb74a7fa6960d036cef28ed10e.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 47f9adc94a55432c650ab151d4dbb3ec, NAME => 'testtb-testExportWithTargetName,1,1690218399485.47f9adc94a55432c650ab151d4dbb3ec.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 17:06:58,289 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-24 17:06:58,289 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690218418289"}]},"ts":"9223372036854775807"} 2023-07-24 17:06:58,292 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-24 17:06:58,295 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 17:06:58,297 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 79 msec 2023-07-24 17:06:58,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-24 17:06:58,339 INFO [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-24 17:06:58,360 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-24 17:06:58,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:58,366 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-24 17:06:58,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-24 17:06:58,401 INFO [Listener at jenkins-hbase4.apache.org/34881] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=755 (was 707) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1282 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6b0b3732-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6b0b3732-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/cluster_4cc708a3-96e2-4835-db32-d049ee6d4ce3/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/cluster_4cc708a3-96e2-4835-db32-d049ee6d4ce3/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/cluster_4cc708a3-96e2-4835-db32-d049ee6d4ce3/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1822682432) connection to jenkins-hbase4.apache.org/172.31.14.131:37149 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x6b0b3732-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1183051401_1 at /127.0.0.1:45544 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-789691247_17 at /127.0.0.1:42272 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/cluster_4cc708a3-96e2-4835-db32-d049ee6d4ce3/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/cluster_4cc708a3-96e2-4835-db32-d049ee6d4ce3/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-789691247_17 at /127.0.0.1:45560 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6b0b3732-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1183051401_1 at /127.0.0.1:36144 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1822682432) connection to jenkins-hbase4.apache.org/172.31.14.131:41925 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-789691247_17 at /127.0.0.1:36166 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/cluster_4cc708a3-96e2-4835-db32-d049ee6d4ce3/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=919 (was 907) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=235 (was 174) - SystemLoadAverage LEAK? -, ProcessCount=179 (was 174) - ProcessCount LEAK? -, AvailableMemoryMB=6009 (was 7764) 2023-07-24 17:06:58,402 WARN [Listener at jenkins-hbase4.apache.org/34881] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-07-24 17:06:58,430 INFO [Listener at jenkins-hbase4.apache.org/34881] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=755, OpenFileDescriptor=919, MaxFileDescriptor=60000, SystemLoadAverage=235, ProcessCount=179, AvailableMemoryMB=6007 2023-07-24 17:06:58,431 WARN [Listener at jenkins-hbase4.apache.org/34881] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-07-24 17:06:58,433 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-24 17:06:58,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-24 17:06:58,439 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 17:06:58,439 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-24 17:06:58,440 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 17:06:58,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-24 17:06:58,443 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemState/59f96f9d455d963d82fc0f8ce8ecf164 2023-07-24 17:06:58,444 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemState/f01205b9b6f34632f72ff8f9f8b9a7d8 2023-07-24 17:06:58,444 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemState/59f96f9d455d963d82fc0f8ce8ecf164 empty. 2023-07-24 17:06:58,444 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemState/f01205b9b6f34632f72ff8f9f8b9a7d8 empty. 2023-07-24 17:06:58,445 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemState/59f96f9d455d963d82fc0f8ce8ecf164 2023-07-24 17:06:58,445 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemState/f01205b9b6f34632f72ff8f9f8b9a7d8 2023-07-24 17:06:58,445 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-24 17:06:58,470 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-24 17:06:58,472 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => f01205b9b6f34632f72ff8f9f8b9a7d8, NAME => 'testtb-testExportFileSystemState,1,1690218418433.f01205b9b6f34632f72ff8f9f8b9a7d8.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp 2023-07-24 17:06:58,472 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 59f96f9d455d963d82fc0f8ce8ecf164, NAME => 'testtb-testExportFileSystemState,,1690218418433.59f96f9d455d963d82fc0f8ce8ecf164.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp 2023-07-24 17:06:58,514 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1690218418433.f01205b9b6f34632f72ff8f9f8b9a7d8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:06:58,515 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing f01205b9b6f34632f72ff8f9f8b9a7d8, disabling compactions & flushes 2023-07-24 17:06:58,515 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1690218418433.f01205b9b6f34632f72ff8f9f8b9a7d8. 2023-07-24 17:06:58,516 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1690218418433.f01205b9b6f34632f72ff8f9f8b9a7d8. 2023-07-24 17:06:58,516 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1690218418433.f01205b9b6f34632f72ff8f9f8b9a7d8. after waiting 0 ms 2023-07-24 17:06:58,516 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1690218418433.f01205b9b6f34632f72ff8f9f8b9a7d8. 2023-07-24 17:06:58,516 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1690218418433.f01205b9b6f34632f72ff8f9f8b9a7d8. 2023-07-24 17:06:58,516 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for f01205b9b6f34632f72ff8f9f8b9a7d8: 2023-07-24 17:06:58,516 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1690218418433.59f96f9d455d963d82fc0f8ce8ecf164.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:06:58,517 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 59f96f9d455d963d82fc0f8ce8ecf164, disabling compactions & flushes 2023-07-24 17:06:58,517 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1690218418433.59f96f9d455d963d82fc0f8ce8ecf164. 2023-07-24 17:06:58,517 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1690218418433.59f96f9d455d963d82fc0f8ce8ecf164. 2023-07-24 17:06:58,517 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1690218418433.59f96f9d455d963d82fc0f8ce8ecf164. after waiting 0 ms 2023-07-24 17:06:58,517 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1690218418433.59f96f9d455d963d82fc0f8ce8ecf164. 2023-07-24 17:06:58,517 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1690218418433.59f96f9d455d963d82fc0f8ce8ecf164. 2023-07-24 17:06:58,517 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 59f96f9d455d963d82fc0f8ce8ecf164: 2023-07-24 17:06:58,520 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 17:06:58,521 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1690218418433.f01205b9b6f34632f72ff8f9f8b9a7d8.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690218418521"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218418521"}]},"ts":"1690218418521"} 2023-07-24 17:06:58,522 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1690218418433.59f96f9d455d963d82fc0f8ce8ecf164.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690218418521"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218418521"}]},"ts":"1690218418521"} 2023-07-24 17:06:58,525 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 17:06:58,526 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 17:06:58,527 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218418527"}]},"ts":"1690218418527"} 2023-07-24 17:06:58,529 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-24 17:06:58,533 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 17:06:58,534 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 17:06:58,535 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 17:06:58,535 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 17:06:58,535 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 17:06:58,535 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=59f96f9d455d963d82fc0f8ce8ecf164, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f01205b9b6f34632f72ff8f9f8b9a7d8, ASSIGN}] 2023-07-24 17:06:58,539 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=59f96f9d455d963d82fc0f8ce8ecf164, ASSIGN 2023-07-24 17:06:58,539 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f01205b9b6f34632f72ff8f9f8b9a7d8, ASSIGN 2023-07-24 17:06:58,540 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f01205b9b6f34632f72ff8f9f8b9a7d8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43483,1690218390174; forceNewPlan=false, retain=false 2023-07-24 17:06:58,540 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=59f96f9d455d963d82fc0f8ce8ecf164, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44109,1690218390103; forceNewPlan=false, retain=false 2023-07-24 17:06:58,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-24 17:06:58,690 INFO [jenkins-hbase4:46651] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 17:06:58,693 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=59f96f9d455d963d82fc0f8ce8ecf164, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:58,693 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=f01205b9b6f34632f72ff8f9f8b9a7d8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:58,693 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1690218418433.59f96f9d455d963d82fc0f8ce8ecf164.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690218418693"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218418693"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218418693"}]},"ts":"1690218418693"} 2023-07-24 17:06:58,693 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1690218418433.f01205b9b6f34632f72ff8f9f8b9a7d8.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690218418693"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218418693"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218418693"}]},"ts":"1690218418693"} 2023-07-24 17:06:58,695 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure 59f96f9d455d963d82fc0f8ce8ecf164, server=jenkins-hbase4.apache.org,44109,1690218390103}] 2023-07-24 17:06:58,696 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure f01205b9b6f34632f72ff8f9f8b9a7d8, server=jenkins-hbase4.apache.org,43483,1690218390174}] 2023-07-24 17:06:58,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-24 17:06:58,851 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1690218418433.59f96f9d455d963d82fc0f8ce8ecf164. 2023-07-24 17:06:58,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 59f96f9d455d963d82fc0f8ce8ecf164, NAME => 'testtb-testExportFileSystemState,,1690218418433.59f96f9d455d963d82fc0f8ce8ecf164.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 17:06:58,852 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1690218418433.f01205b9b6f34632f72ff8f9f8b9a7d8. 2023-07-24 17:06:58,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f01205b9b6f34632f72ff8f9f8b9a7d8, NAME => 'testtb-testExportFileSystemState,1,1690218418433.f01205b9b6f34632f72ff8f9f8b9a7d8.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 17:06:58,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1690218418433.59f96f9d455d963d82fc0f8ce8ecf164. service=AccessControlService 2023-07-24 17:06:58,852 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 17:06:58,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 59f96f9d455d963d82fc0f8ce8ecf164 2023-07-24 17:06:58,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1690218418433.59f96f9d455d963d82fc0f8ce8ecf164.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:06:58,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 59f96f9d455d963d82fc0f8ce8ecf164 2023-07-24 17:06:58,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 59f96f9d455d963d82fc0f8ce8ecf164 2023-07-24 17:06:58,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1690218418433.f01205b9b6f34632f72ff8f9f8b9a7d8. service=AccessControlService 2023-07-24 17:06:58,853 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 17:06:58,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState f01205b9b6f34632f72ff8f9f8b9a7d8 2023-07-24 17:06:58,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1690218418433.f01205b9b6f34632f72ff8f9f8b9a7d8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:06:58,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f01205b9b6f34632f72ff8f9f8b9a7d8 2023-07-24 17:06:58,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f01205b9b6f34632f72ff8f9f8b9a7d8 2023-07-24 17:06:58,854 INFO [StoreOpener-59f96f9d455d963d82fc0f8ce8ecf164-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 59f96f9d455d963d82fc0f8ce8ecf164 2023-07-24 17:06:58,854 INFO [StoreOpener-f01205b9b6f34632f72ff8f9f8b9a7d8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f01205b9b6f34632f72ff8f9f8b9a7d8 2023-07-24 17:06:58,855 DEBUG [StoreOpener-59f96f9d455d963d82fc0f8ce8ecf164-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemState/59f96f9d455d963d82fc0f8ce8ecf164/cf 2023-07-24 17:06:58,855 DEBUG [StoreOpener-59f96f9d455d963d82fc0f8ce8ecf164-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemState/59f96f9d455d963d82fc0f8ce8ecf164/cf 2023-07-24 17:06:58,856 DEBUG [StoreOpener-f01205b9b6f34632f72ff8f9f8b9a7d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemState/f01205b9b6f34632f72ff8f9f8b9a7d8/cf 2023-07-24 17:06:58,856 DEBUG [StoreOpener-f01205b9b6f34632f72ff8f9f8b9a7d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemState/f01205b9b6f34632f72ff8f9f8b9a7d8/cf 2023-07-24 17:06:58,856 INFO [StoreOpener-59f96f9d455d963d82fc0f8ce8ecf164-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 59f96f9d455d963d82fc0f8ce8ecf164 columnFamilyName cf 2023-07-24 17:06:58,856 INFO [StoreOpener-f01205b9b6f34632f72ff8f9f8b9a7d8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f01205b9b6f34632f72ff8f9f8b9a7d8 columnFamilyName cf 2023-07-24 17:06:58,857 INFO [StoreOpener-59f96f9d455d963d82fc0f8ce8ecf164-1] regionserver.HStore(310): Store=59f96f9d455d963d82fc0f8ce8ecf164/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 17:06:58,858 INFO [StoreOpener-f01205b9b6f34632f72ff8f9f8b9a7d8-1] regionserver.HStore(310): Store=f01205b9b6f34632f72ff8f9f8b9a7d8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 17:06:58,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemState/59f96f9d455d963d82fc0f8ce8ecf164 2023-07-24 17:06:58,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemState/f01205b9b6f34632f72ff8f9f8b9a7d8 2023-07-24 17:06:58,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemState/59f96f9d455d963d82fc0f8ce8ecf164 2023-07-24 17:06:58,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemState/f01205b9b6f34632f72ff8f9f8b9a7d8 2023-07-24 17:06:58,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 59f96f9d455d963d82fc0f8ce8ecf164 2023-07-24 17:06:58,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f01205b9b6f34632f72ff8f9f8b9a7d8 2023-07-24 17:06:58,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemState/59f96f9d455d963d82fc0f8ce8ecf164/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 17:06:58,866 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 59f96f9d455d963d82fc0f8ce8ecf164; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73256388, jitterRate=0.09160524606704712}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 17:06:58,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemState/f01205b9b6f34632f72ff8f9f8b9a7d8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 17:06:58,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 59f96f9d455d963d82fc0f8ce8ecf164: 2023-07-24 17:06:58,867 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f01205b9b6f34632f72ff8f9f8b9a7d8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61037173, jitterRate=-0.09047524631023407}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 17:06:58,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f01205b9b6f34632f72ff8f9f8b9a7d8: 2023-07-24 17:06:58,867 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1690218418433.59f96f9d455d963d82fc0f8ce8ecf164., pid=30, masterSystemTime=1690218418848 2023-07-24 17:06:58,868 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1690218418433.f01205b9b6f34632f72ff8f9f8b9a7d8., pid=31, masterSystemTime=1690218418848 2023-07-24 17:06:58,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1690218418433.59f96f9d455d963d82fc0f8ce8ecf164. 2023-07-24 17:06:58,870 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1690218418433.59f96f9d455d963d82fc0f8ce8ecf164. 2023-07-24 17:06:58,870 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=59f96f9d455d963d82fc0f8ce8ecf164, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:58,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1690218418433.f01205b9b6f34632f72ff8f9f8b9a7d8. 2023-07-24 17:06:58,871 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1690218418433.f01205b9b6f34632f72ff8f9f8b9a7d8. 2023-07-24 17:06:58,871 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1690218418433.59f96f9d455d963d82fc0f8ce8ecf164.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690218418870"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690218418870"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690218418870"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690218418870"}]},"ts":"1690218418870"} 2023-07-24 17:06:58,871 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=f01205b9b6f34632f72ff8f9f8b9a7d8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:58,871 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1690218418433.f01205b9b6f34632f72ff8f9f8b9a7d8.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690218418871"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690218418871"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690218418871"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690218418871"}]},"ts":"1690218418871"} 2023-07-24 17:06:58,875 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=28 2023-07-24 17:06:58,876 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure 59f96f9d455d963d82fc0f8ce8ecf164, server=jenkins-hbase4.apache.org,44109,1690218390103 in 177 msec 2023-07-24 17:06:58,878 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-07-24 17:06:58,879 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure f01205b9b6f34632f72ff8f9f8b9a7d8, server=jenkins-hbase4.apache.org,43483,1690218390174 in 177 msec 2023-07-24 17:06:58,879 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=59f96f9d455d963d82fc0f8ce8ecf164, ASSIGN in 341 msec 2023-07-24 17:06:58,883 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-07-24 17:06:58,883 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f01205b9b6f34632f72ff8f9f8b9a7d8, ASSIGN in 344 msec 2023-07-24 17:06:58,885 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 17:06:58,885 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218418885"}]},"ts":"1690218418885"} 2023-07-24 17:06:58,887 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-24 17:06:58,891 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 17:06:58,892 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-24 17:06:58,898 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37115] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 17:06:58,900 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:06:58,900 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:06:58,900 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:06:58,900 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:06:58,902 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 17:06:58,902 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 17:06:58,902 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 17:06:58,902 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 17:06:58,903 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 17:06:58,906 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 468 msec 2023-07-24 17:06:59,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-24 17:06:59,045 INFO [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-24 17:06:59,045 DEBUG [Listener at jenkins-hbase4.apache.org/34881] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemState get assigned. Timeout = 60000ms 2023-07-24 17:06:59,045 INFO [Listener at jenkins-hbase4.apache.org/34881] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 17:06:59,049 INFO [Listener at jenkins-hbase4.apache.org/34881] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemState assigned to meta. Checking AM states. 2023-07-24 17:06:59,049 INFO [Listener at jenkins-hbase4.apache.org/34881] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 17:06:59,049 INFO [Listener at jenkins-hbase4.apache.org/34881] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemState assigned. 2023-07-24 17:06:59,052 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 17:06:59,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690218419053 (current time:1690218419053). 2023-07-24 17:06:59,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 17:06:59,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(139): Connect 0x71d056e3 to 127.0.0.1:49884 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:06:59,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@42851e3e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:06:59,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:06:59,062 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51120, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:06:59,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x71d056e3 to 127.0.0.1:49884 2023-07-24 17:06:59,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:06:59,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(139): Connect 0x2116ae37 to 127.0.0.1:49884 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:06:59,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@528283b8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:06:59,072 DEBUG [hconnection-0x381c0338-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:06:59,075 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51126, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:06:59,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2116ae37 to 127.0.0.1:49884 2023-07-24 17:06:59,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:06:59,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 17:06:59,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 17:06:59,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 17:06:59,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 17:06:59,087 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 17:06:59,088 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690219019088 2023-07-24 17:06:59,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 17:06:59,088 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-24 17:06:59,090 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 17:06:59,090 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 17:06:59,092 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 17:06:59,092 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 17:06:59,096 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-07-24 17:06:59,098 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 17:06:59,099 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690219019099 2023-07-24 17:06:59,130 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,131 INFO [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-24 17:06:59,131 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:06:59,132 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-24 17:06:59,132 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-24 17:06:59,184 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,185 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,186 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:06:59,186 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:06:59,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:06:59,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:06:59,187 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:59,186 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:06:59,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:06:59,187 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:06:59,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:06:59,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:06:59,188 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:59,188 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:59,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,188 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,189 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,189 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,189 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:59,189 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 17:06:59,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-24 17:06:59,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-24 17:06:59,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,189 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 17:06:59,189 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 17:06:59,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-24 17:06:59,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,190 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 17:06:59,190 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:06:59,190 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,191 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 17:06:59,191 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:06:59,191 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,191 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 17:06:59,191 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:06:59,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 17:06:59,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 17:06:59,192 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 17:06:59,198 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,208 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 17:06:59,208 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-24 17:06:59,208 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43483,1690218390174' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-24 17:06:59,208 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 17:06:59,208 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-24 17:06:59,208 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44109,1690218390103' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-24 17:06:59,208 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 17:06:59,208 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:06:59,210 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 17:06:59,210 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-24 17:06:59,210 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37115,1690218390225' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-24 17:06:59,217 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:59,217 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:59,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:06:59,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:06:59,217 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,218 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:59,218 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,218 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,218 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:06:59,219 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:06:59,219 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:06:59,219 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,219 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:06:59,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:06:59,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:59,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:59,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:59,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:06:59,222 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43483,1690218390174' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-24 17:06:59,222 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27fd12af[Count = 1] remaining members to acquire global barrier 2023-07-24 17:06:59,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:59,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:06:59,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:06:59,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:06:59,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:06:59,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:59,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:59,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:59,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:06:59,226 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44109,1690218390103' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-24 17:06:59,226 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27fd12af[Count = 0] remaining members to acquire global barrier 2023-07-24 17:06:59,226 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-24 17:06:59,226 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,228 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,228 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,228 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,228 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,228 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,228 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 17:06:59,228 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 17:06:59,228 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,228 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:59,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,228 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 17:06:59,228 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 17:06:59,229 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1690218418433.59f96f9d455d963d82fc0f8ce8ecf164. 2023-07-24 17:06:59,228 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-24 17:06:59,229 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1690218418433.59f96f9d455d963d82fc0f8ce8ecf164. started... 2023-07-24 17:06:59,229 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 17:06:59,229 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:59,229 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 17:06:59,229 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37115,1690218390225' in zk 2023-07-24 17:06:59,229 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 17:06:59,229 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 17:06:59,229 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1690218418433.f01205b9b6f34632f72ff8f9f8b9a7d8. 2023-07-24 17:06:59,231 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 59f96f9d455d963d82fc0f8ce8ecf164: 2023-07-24 17:06:59,231 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1690218418433.f01205b9b6f34632f72ff8f9f8b9a7d8. started... 2023-07-24 17:06:59,231 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1690218418433.59f96f9d455d963d82fc0f8ce8ecf164.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,231 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 17:06:59,232 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f01205b9b6f34632f72ff8f9f8b9a7d8: 2023-07-24 17:06:59,233 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 17:06:59,233 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1690218418433.f01205b9b6f34632f72ff8f9f8b9a7d8.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,233 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 17:06:59,233 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 17:06:59,235 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 17:06:59,235 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:06:59,235 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-24 17:06:59,282 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1690218418433.59f96f9d455d963d82fc0f8ce8ecf164. completed. 2023-07-24 17:06:59,282 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1690218418433.59f96f9d455d963d82fc0f8ce8ecf164. 2023-07-24 17:06:59,282 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 17:06:59,282 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 17:06:59,282 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:59,282 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-24 17:06:59,282 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44109,1690218390103' in zk 2023-07-24 17:06:59,283 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1690218418433.f01205b9b6f34632f72ff8f9f8b9a7d8. completed. 2023-07-24 17:06:59,283 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1690218418433.f01205b9b6f34632f72ff8f9f8b9a7d8. 2023-07-24 17:06:59,283 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 17:06:59,283 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 17:06:59,283 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:59,283 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-24 17:06:59,283 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43483,1690218390174' in zk 2023-07-24 17:06:59,285 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 17:06:59,285 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:59,285 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:06:59,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:59,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:06:59,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:06:59,285 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-24 17:06:59,287 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:59,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:06:59,288 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 17:06:59,288 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:06:59,288 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-24 17:06:59,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:06:59,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:59,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:59,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:59,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:06:59,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:59,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:59,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:59,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,43483,1690218390174': 2023-07-24 17:06:59,295 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43483,1690218390174' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-24 17:06:59,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:59,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:06:59,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:06:59,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:06:59,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:06:59,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:59,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:59,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:59,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:06:59,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:59,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:59,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:59,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,44109,1690218390103': 2023-07-24 17:06:59,300 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44109,1690218390103' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-24 17:06:59,300 INFO [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-24 17:06:59,300 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 17:06:59,300 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 17:06:59,300 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,300 INFO [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 17:06:59,302 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,302 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,302 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,302 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:06:59,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,302 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:06:59,302 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,302 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:06:59,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:06:59,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:06:59,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:06:59,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:06:59,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:06:59,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:06:59,303 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:59,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:06:59,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:06:59,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,304 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:59,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:06:59,304 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:59,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:06:59,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:59,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:59,306 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:59,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:59,307 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:59,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:06:59,307 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:59,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:59,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:59,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:59,311 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:06:59,311 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:06:59,311 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:59,311 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:06:59,312 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:06:59,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:06:59,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:06:59,311 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:06:59,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:06:59,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:06:59,312 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:06:59,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:06:59,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:06:59,312 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,312 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:06:59,312 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,312 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:59,314 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:59,314 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,314 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:59,314 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,314 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:59,314 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:59,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:06:59,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:06:59,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:06:59,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:06:59,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:06:59,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:06:59,315 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,314 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,315 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,316 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,359 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,392 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:06:59,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 17:06:59,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 17:06:59,394 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 17:06:59,424 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-24 17:06:59,424 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,425 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,425 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1690218419088Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1690218419314 (+226 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1690218419315 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemState at 1690218419321 (+6 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1690218419341 (+20 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1690218419424 (+83 ms) 2023-07-24 17:06:59,427 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 17:06:59,430 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 339 msec 2023-07-24 17:06:59,695 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:06:59,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 17:06:59,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 17:06:59,709 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44109] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1690218418433.59f96f9d455d963d82fc0f8ce8ecf164. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 17:06:59,710 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43483] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1690218418433.f01205b9b6f34632f72ff8f9f8b9a7d8. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 17:06:59,715 DEBUG [Listener at jenkins-hbase4.apache.org/34881] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-24 17:06:59,715 DEBUG [Listener at jenkins-hbase4.apache.org/34881] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1690218418433.59f96f9d455d963d82fc0f8ce8ecf164. 2023-07-24 17:06:59,717 INFO [Listener at jenkins-hbase4.apache.org/34881] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 17:06:59,732 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 17:06:59,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690218419732 (current time:1690218419732). 2023-07-24 17:06:59,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 17:06:59,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(139): Connect 0x19936e13 to 127.0.0.1:49884 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:06:59,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2ab8d283, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:06:59,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:06:59,748 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51140, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:06:59,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x19936e13 to 127.0.0.1:49884 2023-07-24 17:06:59,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:06:59,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(139): Connect 0x22096817 to 127.0.0.1:49884 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:06:59,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c288bf7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:06:59,760 DEBUG [hconnection-0x723638c8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:06:59,761 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51150, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:06:59,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x22096817 to 127.0.0.1:49884 2023-07-24 17:06:59,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:06:59,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 17:06:59,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 17:06:59,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 17:06:59,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 17:06:59,776 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 17:06:59,777 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690219019777 2023-07-24 17:06:59,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 17:06:59,777 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-24 17:06:59,779 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 17:06:59,779 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 17:06:59,781 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 17:06:59,781 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 17:06:59,783 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 10 msec 2023-07-24 17:06:59,784 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 17:06:59,785 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690219019785 2023-07-24 17:06:59,804 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-24 17:06:59,805 INFO [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-24 17:06:59,805 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:06:59,806 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-24 17:06:59,806 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-24 17:06:59,807 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,807 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,809 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:06:59,809 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:06:59,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:06:59,809 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:59,809 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:06:59,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:06:59,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:06:59,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:06:59,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:06:59,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:06:59,810 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:59,810 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:59,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,810 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:59,810 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,810 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 17:06:59,810 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,810 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-24 17:06:59,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-24 17:06:59,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-24 17:06:59,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,811 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 17:06:59,811 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 17:06:59,811 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 17:06:59,811 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-24 17:06:59,811 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 17:06:59,811 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-24 17:06:59,811 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:06:59,811 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 17:06:59,811 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-24 17:06:59,813 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:06:59,813 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 17:06:59,814 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 17:06:59,814 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-24 17:06:59,813 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 17:06:59,814 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-24 17:06:59,814 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43483,1690218390174' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-24 17:06:59,814 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37115,1690218390225' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-24 17:06:59,814 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:06:59,815 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 17:06:59,815 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-24 17:06:59,815 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44109,1690218390103' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-24 17:06:59,817 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,817 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,817 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:59,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:59,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:06:59,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:06:59,818 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:59,818 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,818 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:06:59,818 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,818 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:06:59,818 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:06:59,818 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,818 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:06:59,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:06:59,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 17:06:59,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:59,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:59,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:59,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:06:59,820 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44109,1690218390103' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-24 17:06:59,820 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@13e00db5[Count = 1] remaining members to acquire global barrier 2023-07-24 17:06:59,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:59,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:06:59,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:06:59,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:06:59,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:06:59,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 17:06:59,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:59,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:59,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:59,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:06:59,822 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43483,1690218390174' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-24 17:06:59,822 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@13e00db5[Count = 0] remaining members to acquire global barrier 2023-07-24 17:06:59,822 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-24 17:06:59,822 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,823 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,823 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,823 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,823 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 17:06:59,823 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:59,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,824 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 17:06:59,824 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 17:06:59,823 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 17:06:59,824 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 17:06:59,824 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-24 17:06:59,824 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37115,1690218390225' in zk 2023-07-24 17:06:59,824 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1690218418433.59f96f9d455d963d82fc0f8ce8ecf164. 2023-07-24 17:06:59,824 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1690218418433.f01205b9b6f34632f72ff8f9f8b9a7d8. 2023-07-24 17:06:59,824 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1690218418433.59f96f9d455d963d82fc0f8ce8ecf164. started... 2023-07-24 17:06:59,824 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1690218418433.f01205b9b6f34632f72ff8f9f8b9a7d8. started... 2023-07-24 17:06:59,824 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:59,824 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 17:06:59,824 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 17:06:59,824 INFO [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 59f96f9d455d963d82fc0f8ce8ecf164 1/1 column families, dataSize=467 B heapSize=1.23 KB 2023-07-24 17:06:59,824 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 17:06:59,824 INFO [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f01205b9b6f34632f72ff8f9f8b9a7d8 1/1 column families, dataSize=2.80 KB heapSize=6.30 KB 2023-07-24 17:06:59,826 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 17:06:59,826 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:06:59,826 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-24 17:06:59,840 INFO [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=467 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemState/59f96f9d455d963d82fc0f8ce8ecf164/.tmp/cf/0bd8f9a3a30c49ffae54bebf98b1dd13 2023-07-24 17:06:59,842 INFO [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.80 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemState/f01205b9b6f34632f72ff8f9f8b9a7d8/.tmp/cf/2f5fa7ba912f4a4f90d975419c11853c 2023-07-24 17:06:59,851 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemState/59f96f9d455d963d82fc0f8ce8ecf164/.tmp/cf/0bd8f9a3a30c49ffae54bebf98b1dd13 as hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemState/59f96f9d455d963d82fc0f8ce8ecf164/cf/0bd8f9a3a30c49ffae54bebf98b1dd13 2023-07-24 17:06:59,852 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemState/f01205b9b6f34632f72ff8f9f8b9a7d8/.tmp/cf/2f5fa7ba912f4a4f90d975419c11853c as hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemState/f01205b9b6f34632f72ff8f9f8b9a7d8/cf/2f5fa7ba912f4a4f90d975419c11853c 2023-07-24 17:06:59,859 INFO [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemState/59f96f9d455d963d82fc0f8ce8ecf164/cf/0bd8f9a3a30c49ffae54bebf98b1dd13, entries=7, sequenceid=6, filesize=5.3 K 2023-07-24 17:06:59,859 INFO [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemState/f01205b9b6f34632f72ff8f9f8b9a7d8/cf/2f5fa7ba912f4a4f90d975419c11853c, entries=43, sequenceid=6, filesize=7.7 K 2023-07-24 17:06:59,862 INFO [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~467 B/467, heapSize ~1.22 KB/1248, currentSize=0 B/0 for 59f96f9d455d963d82fc0f8ce8ecf164 in 38ms, sequenceid=6, compaction requested=false 2023-07-24 17:06:59,862 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-24 17:06:59,862 INFO [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.80 KB/2869, heapSize ~6.28 KB/6432, currentSize=0 B/0 for f01205b9b6f34632f72ff8f9f8b9a7d8 in 38ms, sequenceid=6, compaction requested=false 2023-07-24 17:06:59,862 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-24 17:06:59,865 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 59f96f9d455d963d82fc0f8ce8ecf164: 2023-07-24 17:06:59,865 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f01205b9b6f34632f72ff8f9f8b9a7d8: 2023-07-24 17:06:59,865 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1690218418433.59f96f9d455d963d82fc0f8ce8ecf164.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-24 17:06:59,865 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1690218418433.f01205b9b6f34632f72ff8f9f8b9a7d8.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-24 17:06:59,865 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 17:06:59,865 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 17:06:59,865 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemState/59f96f9d455d963d82fc0f8ce8ecf164/cf/0bd8f9a3a30c49ffae54bebf98b1dd13] hfiles 2023-07-24 17:06:59,865 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemState/f01205b9b6f34632f72ff8f9f8b9a7d8/cf/2f5fa7ba912f4a4f90d975419c11853c] hfiles 2023-07-24 17:06:59,865 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemState/59f96f9d455d963d82fc0f8ce8ecf164/cf/0bd8f9a3a30c49ffae54bebf98b1dd13 for snapshot=snaptb0-testExportFileSystemState 2023-07-24 17:06:59,865 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemState/f01205b9b6f34632f72ff8f9f8b9a7d8/cf/2f5fa7ba912f4a4f90d975419c11853c for snapshot=snaptb0-testExportFileSystemState 2023-07-24 17:06:59,879 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:06:59,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 17:06:59,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 17:06:59,881 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 17:06:59,891 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1690218418433.f01205b9b6f34632f72ff8f9f8b9a7d8. completed. 2023-07-24 17:06:59,891 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1690218418433.f01205b9b6f34632f72ff8f9f8b9a7d8. 2023-07-24 17:06:59,891 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 17:06:59,891 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 17:06:59,891 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:59,891 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-24 17:06:59,891 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43483,1690218390174' in zk 2023-07-24 17:06:59,896 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 17:06:59,896 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:59,896 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:06:59,896 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-24 17:06:59,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:59,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:06:59,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:06:59,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:06:59,897 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1690218418433.59f96f9d455d963d82fc0f8ce8ecf164. completed. 2023-07-24 17:06:59,897 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1690218418433.59f96f9d455d963d82fc0f8ce8ecf164. 2023-07-24 17:06:59,897 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 17:06:59,897 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 17:06:59,898 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:59,898 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-24 17:06:59,898 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44109,1690218390103' in zk 2023-07-24 17:06:59,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:06:59,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 17:06:59,901 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 17:06:59,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:59,901 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:06:59,901 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:59,901 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-24 17:06:59,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:59,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:59,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:06:59,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 17:06:59,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:59,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:59,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:59,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,43483,1690218390174': 2023-07-24 17:06:59,907 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43483,1690218390174' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-24 17:06:59,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:59,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:06:59,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:06:59,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:06:59,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:06:59,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 17:06:59,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:59,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:59,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:59,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:06:59,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 17:06:59,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:59,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:59,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:59,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,44109,1690218390103': 2023-07-24 17:06:59,911 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44109,1690218390103' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-24 17:06:59,911 INFO [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-24 17:06:59,911 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 17:06:59,911 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 17:06:59,911 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-24 17:06:59,912 INFO [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 17:06:59,917 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,917 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,917 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:06:59,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,917 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:06:59,917 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,918 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:06:59,917 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:06:59,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:06:59,918 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:59,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:06:59,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:06:59,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:06:59,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:06:59,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:06:59,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:06:59,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:06:59,922 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:59,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,922 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:59,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 17:06:59,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:06:59,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 17:06:59,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:59,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:59,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:59,924 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:59,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:06:59,924 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:59,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 17:06:59,925 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:59,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:59,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:59,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:59,928 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:06:59,928 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:06:59,928 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:59,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:06:59,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:06:59,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:06:59,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:06:59,929 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:06:59,929 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:06:59,929 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,928 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:06:59,931 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:59,929 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-24 17:06:59,931 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:06:59,931 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-24 17:06:59,931 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:06:59,931 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:59,932 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,932 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:06:59,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:06:59,932 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,932 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:06:59,932 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:06:59,932 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,932 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:06:59,932 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:06:59,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:06:59,933 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:06:59,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:06:59,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:06:59,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:06:59,978 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,998 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-24 17:06:59,998 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,998 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,998 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1690218419778Consolidate snapshot: snaptb0-testExportFileSystemState at 1690218419931 (+153 ms)Loading Region manifests for snaptb0-testExportFileSystemState at 1690218419931Writing data manifest for snaptb0-testExportFileSystemState at 1690218419941 (+10 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1690218419970 (+29 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1690218419998 (+28 ms) 2023-07-24 17:07:00,001 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 17:07:00,003 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 222 msec 2023-07-24 17:07:00,081 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:07:00,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 17:07:00,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 17:07:00,086 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/export-test/export-1690218420086 2023-07-24 17:07:00,087 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:41733, tgtDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/export-test/export-1690218420086, rawTgtDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/export-test/export-1690218420086, srcFsUri=hdfs://localhost:41733, srcDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d 2023-07-24 17:07:00,110 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:41733, inputRoot=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d 2023-07-24 17:07:00,110 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1172747747_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/export-test/export-1690218420086, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/export-test/export-1690218420086/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 17:07:00,110 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:41733, inputRoot=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d, snapshotDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-24 17:07:00,120 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/export-test/export-1690218420086/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 17:07:00,151 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 17:07:00,151 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 17:07:00,152 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 17:07:00,152 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 17:07:00,152 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-24 17:07:00,153 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 17:07:00,153 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 17:07:00,230 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/hadoop-7642632777247187274.jar 2023-07-24 17:07:00,231 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 17:07:00,231 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 17:07:00,231 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 17:07:00,232 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 17:07:00,232 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 17:07:00,232 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 17:07:00,233 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 17:07:00,233 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 17:07:00,233 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 17:07:00,234 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 17:07:00,234 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 17:07:00,235 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 17:07:00,235 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 17:07:00,235 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 17:07:00,236 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 17:07:00,236 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 17:07:00,237 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 17:07:00,237 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 17:07:00,237 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 17:07:00,238 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 17:07:00,238 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 17:07:00,238 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 17:07:00,238 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 17:07:00,758 WARN [Listener at jenkins-hbase4.apache.org/34881] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 17:07:00,761 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-24 17:07:00,764 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-24 17:07:02,486 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 17:07:02,487 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 17:07:02,493 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397910_0001_000001 (auth:SIMPLE) 2023-07-24 17:07:03,361 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397910_0002_000001 (auth:SIMPLE) 2023-07-24 17:07:03,704 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 17:07:38,604 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397910_0002_000001 (auth:SIMPLE) 2023-07-24 17:07:40,850 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397910_0002_000001 (auth:SIMPLE) 2023-07-24 17:07:43,802 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397910_0002_000001 (auth:SIMPLE) 2023-07-24 17:07:45,121 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 17:07:45,124 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 17:07:45,132 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-24 17:07:45,132 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 17:07:45,134 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 17:07:45,134 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-789691247_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-24 17:07:45,135 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(367): hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-24 17:07:45,135 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(367): hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-24 17:07:45,135 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-789691247_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/export-test/export-1690218420086/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/export-test/export-1690218420086/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-24 17:07:45,135 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(367): hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/export-test/export-1690218420086/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-24 17:07:45,135 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(367): hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/export-test/export-1690218420086/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-24 17:07:45,142 INFO [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-24 17:07:45,142 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-24 17:07:45,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-24 17:07:45,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-24 17:07:45,147 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218465147"}]},"ts":"1690218465147"} 2023-07-24 17:07:45,149 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-24 17:07:45,151 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-24 17:07:45,152 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=59f96f9d455d963d82fc0f8ce8ecf164, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f01205b9b6f34632f72ff8f9f8b9a7d8, UNASSIGN}] 2023-07-24 17:07:45,154 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=59f96f9d455d963d82fc0f8ce8ecf164, UNASSIGN 2023-07-24 17:07:45,154 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f01205b9b6f34632f72ff8f9f8b9a7d8, UNASSIGN 2023-07-24 17:07:45,155 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=59f96f9d455d963d82fc0f8ce8ecf164, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:07:45,155 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=f01205b9b6f34632f72ff8f9f8b9a7d8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:07:45,156 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1690218418433.59f96f9d455d963d82fc0f8ce8ecf164.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690218465155"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218465155"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218465155"}]},"ts":"1690218465155"} 2023-07-24 17:07:45,156 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1690218418433.f01205b9b6f34632f72ff8f9f8b9a7d8.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690218465155"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218465155"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218465155"}]},"ts":"1690218465155"} 2023-07-24 17:07:45,158 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 59f96f9d455d963d82fc0f8ce8ecf164, server=jenkins-hbase4.apache.org,44109,1690218390103}] 2023-07-24 17:07:45,159 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure f01205b9b6f34632f72ff8f9f8b9a7d8, server=jenkins-hbase4.apache.org,43483,1690218390174}] 2023-07-24 17:07:45,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-24 17:07:45,311 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 59f96f9d455d963d82fc0f8ce8ecf164 2023-07-24 17:07:45,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 59f96f9d455d963d82fc0f8ce8ecf164, disabling compactions & flushes 2023-07-24 17:07:45,311 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1690218418433.59f96f9d455d963d82fc0f8ce8ecf164. 2023-07-24 17:07:45,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1690218418433.59f96f9d455d963d82fc0f8ce8ecf164. 2023-07-24 17:07:45,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1690218418433.59f96f9d455d963d82fc0f8ce8ecf164. after waiting 0 ms 2023-07-24 17:07:45,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1690218418433.59f96f9d455d963d82fc0f8ce8ecf164. 2023-07-24 17:07:45,315 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f01205b9b6f34632f72ff8f9f8b9a7d8 2023-07-24 17:07:45,316 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f01205b9b6f34632f72ff8f9f8b9a7d8, disabling compactions & flushes 2023-07-24 17:07:45,316 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1690218418433.f01205b9b6f34632f72ff8f9f8b9a7d8. 2023-07-24 17:07:45,316 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1690218418433.f01205b9b6f34632f72ff8f9f8b9a7d8. 2023-07-24 17:07:45,316 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1690218418433.f01205b9b6f34632f72ff8f9f8b9a7d8. after waiting 0 ms 2023-07-24 17:07:45,316 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1690218418433.f01205b9b6f34632f72ff8f9f8b9a7d8. 2023-07-24 17:07:45,332 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemState/59f96f9d455d963d82fc0f8ce8ecf164/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 17:07:45,333 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 17:07:45,334 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1690218418433.59f96f9d455d963d82fc0f8ce8ecf164. 2023-07-24 17:07:45,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 59f96f9d455d963d82fc0f8ce8ecf164: 2023-07-24 17:07:45,335 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemState/f01205b9b6f34632f72ff8f9f8b9a7d8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 17:07:45,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 17:07:45,337 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1690218418433.f01205b9b6f34632f72ff8f9f8b9a7d8. 2023-07-24 17:07:45,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f01205b9b6f34632f72ff8f9f8b9a7d8: 2023-07-24 17:07:45,337 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 59f96f9d455d963d82fc0f8ce8ecf164 2023-07-24 17:07:45,338 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=59f96f9d455d963d82fc0f8ce8ecf164, regionState=CLOSED 2023-07-24 17:07:45,338 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1690218418433.59f96f9d455d963d82fc0f8ce8ecf164.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690218465338"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218465338"}]},"ts":"1690218465338"} 2023-07-24 17:07:45,338 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f01205b9b6f34632f72ff8f9f8b9a7d8 2023-07-24 17:07:45,339 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=f01205b9b6f34632f72ff8f9f8b9a7d8, regionState=CLOSED 2023-07-24 17:07:45,339 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1690218418433.f01205b9b6f34632f72ff8f9f8b9a7d8.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690218465339"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218465339"}]},"ts":"1690218465339"} 2023-07-24 17:07:45,344 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-24 17:07:45,344 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-24 17:07:45,344 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure f01205b9b6f34632f72ff8f9f8b9a7d8, server=jenkins-hbase4.apache.org,43483,1690218390174 in 182 msec 2023-07-24 17:07:45,344 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 59f96f9d455d963d82fc0f8ce8ecf164, server=jenkins-hbase4.apache.org,44109,1690218390103 in 183 msec 2023-07-24 17:07:45,346 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=59f96f9d455d963d82fc0f8ce8ecf164, UNASSIGN in 192 msec 2023-07-24 17:07:45,347 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-24 17:07:45,347 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f01205b9b6f34632f72ff8f9f8b9a7d8, UNASSIGN in 192 msec 2023-07-24 17:07:45,348 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218465348"}]},"ts":"1690218465348"} 2023-07-24 17:07:45,350 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-24 17:07:45,352 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-24 17:07:45,354 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 210 msec 2023-07-24 17:07:45,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-24 17:07:45,449 INFO [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-24 17:07:45,450 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-24 17:07:45,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 17:07:45,454 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 17:07:45,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-24 17:07:45,455 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 17:07:45,456 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37115] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-24 17:07:45,460 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 17:07:45,460 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 17:07:45,460 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 17:07:45,460 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemState/f01205b9b6f34632f72ff8f9f8b9a7d8 2023-07-24 17:07:45,460 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemState/59f96f9d455d963d82fc0f8ce8ecf164 2023-07-24 17:07:45,460 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 17:07:45,460 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-24 17:07:45,460 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-24 17:07:45,461 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-24 17:07:45,461 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 17:07:45,461 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:07:45,462 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 17:07:45,462 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:07:45,462 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:07:45,462 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data null 2023-07-24 17:07:45,462 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 17:07:45,463 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 17:07:45,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-24 17:07:45,463 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:07:45,463 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemState/59f96f9d455d963d82fc0f8ce8ecf164/cf, FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemState/59f96f9d455d963d82fc0f8ce8ecf164/recovered.edits] 2023-07-24 17:07:45,463 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemState/f01205b9b6f34632f72ff8f9f8b9a7d8/cf, FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemState/f01205b9b6f34632f72ff8f9f8b9a7d8/recovered.edits] 2023-07-24 17:07:45,468 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemState/59f96f9d455d963d82fc0f8ce8ecf164/cf/0bd8f9a3a30c49ffae54bebf98b1dd13 to hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/archive/data/default/testtb-testExportFileSystemState/59f96f9d455d963d82fc0f8ce8ecf164/cf/0bd8f9a3a30c49ffae54bebf98b1dd13 2023-07-24 17:07:45,468 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemState/f01205b9b6f34632f72ff8f9f8b9a7d8/cf/2f5fa7ba912f4a4f90d975419c11853c to hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/archive/data/default/testtb-testExportFileSystemState/f01205b9b6f34632f72ff8f9f8b9a7d8/cf/2f5fa7ba912f4a4f90d975419c11853c 2023-07-24 17:07:45,471 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemState/59f96f9d455d963d82fc0f8ce8ecf164/recovered.edits/9.seqid to hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/archive/data/default/testtb-testExportFileSystemState/59f96f9d455d963d82fc0f8ce8ecf164/recovered.edits/9.seqid 2023-07-24 17:07:45,472 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemState/f01205b9b6f34632f72ff8f9f8b9a7d8/recovered.edits/9.seqid to hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/archive/data/default/testtb-testExportFileSystemState/f01205b9b6f34632f72ff8f9f8b9a7d8/recovered.edits/9.seqid 2023-07-24 17:07:45,472 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemState/59f96f9d455d963d82fc0f8ce8ecf164 2023-07-24 17:07:45,472 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemState/f01205b9b6f34632f72ff8f9f8b9a7d8 2023-07-24 17:07:45,476 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-24 17:07:45,478 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 17:07:45,481 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-24 17:07:45,484 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-24 17:07:45,485 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 17:07:45,485 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-24 17:07:45,485 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1690218418433.59f96f9d455d963d82fc0f8ce8ecf164.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690218465485"}]},"ts":"9223372036854775807"} 2023-07-24 17:07:45,485 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1690218418433.f01205b9b6f34632f72ff8f9f8b9a7d8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690218465485"}]},"ts":"9223372036854775807"} 2023-07-24 17:07:45,487 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 17:07:45,487 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 59f96f9d455d963d82fc0f8ce8ecf164, NAME => 'testtb-testExportFileSystemState,,1690218418433.59f96f9d455d963d82fc0f8ce8ecf164.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => f01205b9b6f34632f72ff8f9f8b9a7d8, NAME => 'testtb-testExportFileSystemState,1,1690218418433.f01205b9b6f34632f72ff8f9f8b9a7d8.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 17:07:45,487 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-24 17:07:45,487 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690218465487"}]},"ts":"9223372036854775807"} 2023-07-24 17:07:45,489 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-24 17:07:45,491 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 17:07:45,492 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 41 msec 2023-07-24 17:07:45,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-24 17:07:45,564 INFO [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-24 17:07:45,575 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-24 17:07:45,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-24 17:07:45,580 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-24 17:07:45,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-24 17:07:45,609 INFO [Listener at jenkins-hbase4.apache.org/34881] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=736 (was 755), OpenFileDescriptor=896 (was 919), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=151 (was 235), ProcessCount=179 (was 179), AvailableMemoryMB=5781 (was 6007) 2023-07-24 17:07:45,609 WARN [Listener at jenkins-hbase4.apache.org/34881] hbase.ResourceChecker(130): Thread=736 is superior to 500 2023-07-24 17:07:45,634 INFO [Listener at jenkins-hbase4.apache.org/34881] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=736, OpenFileDescriptor=896, MaxFileDescriptor=60000, SystemLoadAverage=151, ProcessCount=179, AvailableMemoryMB=5780 2023-07-24 17:07:45,634 WARN [Listener at jenkins-hbase4.apache.org/34881] hbase.ResourceChecker(130): Thread=736 is superior to 500 2023-07-24 17:07:45,636 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-24 17:07:45,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-24 17:07:45,641 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 17:07:45,641 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-24 17:07:45,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-24 17:07:45,647 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 17:07:45,649 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testConsecutiveExports/e4bdebdc25a87c2d5b750501e0ad1d40 2023-07-24 17:07:45,649 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testConsecutiveExports/ed0fd81d2214a38a5e750d5f574b2ce4 2023-07-24 17:07:45,650 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testConsecutiveExports/e4bdebdc25a87c2d5b750501e0ad1d40 empty. 2023-07-24 17:07:45,650 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testConsecutiveExports/ed0fd81d2214a38a5e750d5f574b2ce4 empty. 2023-07-24 17:07:45,651 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testConsecutiveExports/e4bdebdc25a87c2d5b750501e0ad1d40 2023-07-24 17:07:45,651 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testConsecutiveExports/ed0fd81d2214a38a5e750d5f574b2ce4 2023-07-24 17:07:45,651 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-24 17:07:45,667 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-24 17:07:45,668 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => e4bdebdc25a87c2d5b750501e0ad1d40, NAME => 'testtb-testConsecutiveExports,,1690218465635.e4bdebdc25a87c2d5b750501e0ad1d40.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp 2023-07-24 17:07:45,669 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => ed0fd81d2214a38a5e750d5f574b2ce4, NAME => 'testtb-testConsecutiveExports,1,1690218465635.ed0fd81d2214a38a5e750d5f574b2ce4.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp 2023-07-24 17:07:45,735 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1690218465635.ed0fd81d2214a38a5e750d5f574b2ce4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:07:45,735 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1690218465635.e4bdebdc25a87c2d5b750501e0ad1d40.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:07:45,735 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing e4bdebdc25a87c2d5b750501e0ad1d40, disabling compactions & flushes 2023-07-24 17:07:45,735 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1690218465635.e4bdebdc25a87c2d5b750501e0ad1d40. 2023-07-24 17:07:45,735 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1690218465635.e4bdebdc25a87c2d5b750501e0ad1d40. 2023-07-24 17:07:45,735 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1690218465635.e4bdebdc25a87c2d5b750501e0ad1d40. after waiting 0 ms 2023-07-24 17:07:45,735 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing ed0fd81d2214a38a5e750d5f574b2ce4, disabling compactions & flushes 2023-07-24 17:07:45,735 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1690218465635.ed0fd81d2214a38a5e750d5f574b2ce4. 2023-07-24 17:07:45,735 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1690218465635.ed0fd81d2214a38a5e750d5f574b2ce4. 2023-07-24 17:07:45,735 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1690218465635.ed0fd81d2214a38a5e750d5f574b2ce4. after waiting 0 ms 2023-07-24 17:07:45,735 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1690218465635.ed0fd81d2214a38a5e750d5f574b2ce4. 2023-07-24 17:07:45,735 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1690218465635.ed0fd81d2214a38a5e750d5f574b2ce4. 2023-07-24 17:07:45,736 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for ed0fd81d2214a38a5e750d5f574b2ce4: 2023-07-24 17:07:45,735 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1690218465635.e4bdebdc25a87c2d5b750501e0ad1d40. 2023-07-24 17:07:45,736 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1690218465635.e4bdebdc25a87c2d5b750501e0ad1d40. 2023-07-24 17:07:45,736 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for e4bdebdc25a87c2d5b750501e0ad1d40: 2023-07-24 17:07:45,740 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 17:07:45,741 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1690218465635.ed0fd81d2214a38a5e750d5f574b2ce4.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690218465741"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218465741"}]},"ts":"1690218465741"} 2023-07-24 17:07:45,741 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1690218465635.e4bdebdc25a87c2d5b750501e0ad1d40.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690218465741"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218465741"}]},"ts":"1690218465741"} 2023-07-24 17:07:45,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-24 17:07:45,744 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 17:07:45,746 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 17:07:45,746 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218465746"}]},"ts":"1690218465746"} 2023-07-24 17:07:45,748 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-24 17:07:45,752 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 17:07:45,754 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 17:07:45,754 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 17:07:45,754 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 17:07:45,754 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 17:07:45,754 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=e4bdebdc25a87c2d5b750501e0ad1d40, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ed0fd81d2214a38a5e750d5f574b2ce4, ASSIGN}] 2023-07-24 17:07:45,757 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=e4bdebdc25a87c2d5b750501e0ad1d40, ASSIGN 2023-07-24 17:07:45,757 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ed0fd81d2214a38a5e750d5f574b2ce4, ASSIGN 2023-07-24 17:07:45,759 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=e4bdebdc25a87c2d5b750501e0ad1d40, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37115,1690218390225; forceNewPlan=false, retain=false 2023-07-24 17:07:45,759 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ed0fd81d2214a38a5e750d5f574b2ce4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44109,1690218390103; forceNewPlan=false, retain=false 2023-07-24 17:07:45,909 INFO [jenkins-hbase4:46651] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 17:07:45,913 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=ed0fd81d2214a38a5e750d5f574b2ce4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:07:45,913 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=e4bdebdc25a87c2d5b750501e0ad1d40, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:07:45,913 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1690218465635.ed0fd81d2214a38a5e750d5f574b2ce4.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690218465913"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218465913"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218465913"}]},"ts":"1690218465913"} 2023-07-24 17:07:45,913 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1690218465635.e4bdebdc25a87c2d5b750501e0ad1d40.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690218465913"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218465913"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218465913"}]},"ts":"1690218465913"} 2023-07-24 17:07:45,916 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure ed0fd81d2214a38a5e750d5f574b2ce4, server=jenkins-hbase4.apache.org,44109,1690218390103}] 2023-07-24 17:07:45,917 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure e4bdebdc25a87c2d5b750501e0ad1d40, server=jenkins-hbase4.apache.org,37115,1690218390225}] 2023-07-24 17:07:45,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-24 17:07:46,077 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1690218465635.ed0fd81d2214a38a5e750d5f574b2ce4. 2023-07-24 17:07:46,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ed0fd81d2214a38a5e750d5f574b2ce4, NAME => 'testtb-testConsecutiveExports,1,1690218465635.ed0fd81d2214a38a5e750d5f574b2ce4.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 17:07:46,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1690218465635.ed0fd81d2214a38a5e750d5f574b2ce4. service=AccessControlService 2023-07-24 17:07:46,078 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 17:07:46,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports ed0fd81d2214a38a5e750d5f574b2ce4 2023-07-24 17:07:46,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1690218465635.ed0fd81d2214a38a5e750d5f574b2ce4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:07:46,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ed0fd81d2214a38a5e750d5f574b2ce4 2023-07-24 17:07:46,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ed0fd81d2214a38a5e750d5f574b2ce4 2023-07-24 17:07:46,084 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1690218465635.e4bdebdc25a87c2d5b750501e0ad1d40. 2023-07-24 17:07:46,084 INFO [StoreOpener-ed0fd81d2214a38a5e750d5f574b2ce4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ed0fd81d2214a38a5e750d5f574b2ce4 2023-07-24 17:07:46,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e4bdebdc25a87c2d5b750501e0ad1d40, NAME => 'testtb-testConsecutiveExports,,1690218465635.e4bdebdc25a87c2d5b750501e0ad1d40.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 17:07:46,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1690218465635.e4bdebdc25a87c2d5b750501e0ad1d40. service=AccessControlService 2023-07-24 17:07:46,084 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 17:07:46,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports e4bdebdc25a87c2d5b750501e0ad1d40 2023-07-24 17:07:46,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1690218465635.e4bdebdc25a87c2d5b750501e0ad1d40.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:07:46,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e4bdebdc25a87c2d5b750501e0ad1d40 2023-07-24 17:07:46,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e4bdebdc25a87c2d5b750501e0ad1d40 2023-07-24 17:07:46,086 DEBUG [StoreOpener-ed0fd81d2214a38a5e750d5f574b2ce4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testConsecutiveExports/ed0fd81d2214a38a5e750d5f574b2ce4/cf 2023-07-24 17:07:46,086 DEBUG [StoreOpener-ed0fd81d2214a38a5e750d5f574b2ce4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testConsecutiveExports/ed0fd81d2214a38a5e750d5f574b2ce4/cf 2023-07-24 17:07:46,087 INFO [StoreOpener-ed0fd81d2214a38a5e750d5f574b2ce4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ed0fd81d2214a38a5e750d5f574b2ce4 columnFamilyName cf 2023-07-24 17:07:46,087 INFO [StoreOpener-e4bdebdc25a87c2d5b750501e0ad1d40-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e4bdebdc25a87c2d5b750501e0ad1d40 2023-07-24 17:07:46,087 INFO [StoreOpener-ed0fd81d2214a38a5e750d5f574b2ce4-1] regionserver.HStore(310): Store=ed0fd81d2214a38a5e750d5f574b2ce4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 17:07:46,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testConsecutiveExports/ed0fd81d2214a38a5e750d5f574b2ce4 2023-07-24 17:07:46,089 DEBUG [StoreOpener-e4bdebdc25a87c2d5b750501e0ad1d40-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testConsecutiveExports/e4bdebdc25a87c2d5b750501e0ad1d40/cf 2023-07-24 17:07:46,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testConsecutiveExports/ed0fd81d2214a38a5e750d5f574b2ce4 2023-07-24 17:07:46,089 DEBUG [StoreOpener-e4bdebdc25a87c2d5b750501e0ad1d40-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testConsecutiveExports/e4bdebdc25a87c2d5b750501e0ad1d40/cf 2023-07-24 17:07:46,089 INFO [StoreOpener-e4bdebdc25a87c2d5b750501e0ad1d40-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e4bdebdc25a87c2d5b750501e0ad1d40 columnFamilyName cf 2023-07-24 17:07:46,090 INFO [StoreOpener-e4bdebdc25a87c2d5b750501e0ad1d40-1] regionserver.HStore(310): Store=e4bdebdc25a87c2d5b750501e0ad1d40/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 17:07:46,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testConsecutiveExports/e4bdebdc25a87c2d5b750501e0ad1d40 2023-07-24 17:07:46,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testConsecutiveExports/e4bdebdc25a87c2d5b750501e0ad1d40 2023-07-24 17:07:46,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ed0fd81d2214a38a5e750d5f574b2ce4 2023-07-24 17:07:46,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testConsecutiveExports/ed0fd81d2214a38a5e750d5f574b2ce4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 17:07:46,096 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ed0fd81d2214a38a5e750d5f574b2ce4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70876326, jitterRate=0.05613955855369568}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 17:07:46,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ed0fd81d2214a38a5e750d5f574b2ce4: 2023-07-24 17:07:46,097 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1690218465635.ed0fd81d2214a38a5e750d5f574b2ce4., pid=45, masterSystemTime=1690218466070 2023-07-24 17:07:46,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e4bdebdc25a87c2d5b750501e0ad1d40 2023-07-24 17:07:46,099 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=ed0fd81d2214a38a5e750d5f574b2ce4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:07:46,100 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1690218465635.ed0fd81d2214a38a5e750d5f574b2ce4.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690218466099"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690218466099"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690218466099"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690218466099"}]},"ts":"1690218466099"} 2023-07-24 17:07:46,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1690218465635.ed0fd81d2214a38a5e750d5f574b2ce4. 2023-07-24 17:07:46,100 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1690218465635.ed0fd81d2214a38a5e750d5f574b2ce4. 2023-07-24 17:07:46,104 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-24 17:07:46,104 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure ed0fd81d2214a38a5e750d5f574b2ce4, server=jenkins-hbase4.apache.org,44109,1690218390103 in 185 msec 2023-07-24 17:07:46,111 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ed0fd81d2214a38a5e750d5f574b2ce4, ASSIGN in 350 msec 2023-07-24 17:07:46,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testConsecutiveExports/e4bdebdc25a87c2d5b750501e0ad1d40/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 17:07:46,112 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e4bdebdc25a87c2d5b750501e0ad1d40; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73182549, jitterRate=0.0905049592256546}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 17:07:46,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e4bdebdc25a87c2d5b750501e0ad1d40: 2023-07-24 17:07:46,113 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1690218465635.e4bdebdc25a87c2d5b750501e0ad1d40., pid=46, masterSystemTime=1690218466071 2023-07-24 17:07:46,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1690218465635.e4bdebdc25a87c2d5b750501e0ad1d40. 2023-07-24 17:07:46,114 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1690218465635.e4bdebdc25a87c2d5b750501e0ad1d40. 2023-07-24 17:07:46,115 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=e4bdebdc25a87c2d5b750501e0ad1d40, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:07:46,115 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1690218465635.e4bdebdc25a87c2d5b750501e0ad1d40.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690218466114"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690218466114"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690218466114"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690218466114"}]},"ts":"1690218466114"} 2023-07-24 17:07:46,118 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-24 17:07:46,118 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure e4bdebdc25a87c2d5b750501e0ad1d40, server=jenkins-hbase4.apache.org,37115,1690218390225 in 199 msec 2023-07-24 17:07:46,120 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-24 17:07:46,120 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=e4bdebdc25a87c2d5b750501e0ad1d40, ASSIGN in 364 msec 2023-07-24 17:07:46,121 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 17:07:46,121 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218466121"}]},"ts":"1690218466121"} 2023-07-24 17:07:46,122 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-24 17:07:46,124 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 17:07:46,125 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-24 17:07:46,126 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37115] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-24 17:07:46,128 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:07:46,128 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:07:46,128 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:07:46,128 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:07:46,130 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-24 17:07:46,130 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-24 17:07:46,130 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-24 17:07:46,130 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-24 17:07:46,131 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 494 msec 2023-07-24 17:07:46,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-24 17:07:46,247 INFO [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-24 17:07:46,247 DEBUG [Listener at jenkins-hbase4.apache.org/34881] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testConsecutiveExports get assigned. Timeout = 60000ms 2023-07-24 17:07:46,247 INFO [Listener at jenkins-hbase4.apache.org/34881] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 17:07:46,250 INFO [Listener at jenkins-hbase4.apache.org/34881] hbase.HBaseTestingUtility(3484): All regions for table testtb-testConsecutiveExports assigned to meta. Checking AM states. 2023-07-24 17:07:46,250 INFO [Listener at jenkins-hbase4.apache.org/34881] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 17:07:46,250 INFO [Listener at jenkins-hbase4.apache.org/34881] hbase.HBaseTestingUtility(3504): All regions for table testtb-testConsecutiveExports assigned. 2023-07-24 17:07:46,253 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 17:07:46,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690218466253 (current time:1690218466253). 2023-07-24 17:07:46,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 17:07:46,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(139): Connect 0x3becd9b0 to 127.0.0.1:49884 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:07:46,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46c1cfe4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:07:46,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:07:46,267 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46514, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:07:46,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3becd9b0 to 127.0.0.1:49884 2023-07-24 17:07:46,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:07:46,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(139): Connect 0x7d02cef3 to 127.0.0.1:49884 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:07:46,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@13334dd4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:07:46,311 DEBUG [hconnection-0x3cf12e10-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:07:46,316 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46520, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:07:46,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7d02cef3 to 127.0.0.1:49884 2023-07-24 17:07:46,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:07:46,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-24 17:07:46,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 17:07:46,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 17:07:46,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 17:07:46,332 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 17:07:46,333 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1690219066333 2023-07-24 17:07:46,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 17:07:46,333 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-24 17:07:46,334 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 17:07:46,335 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 17:07:46,336 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 17:07:46,336 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 17:07:46,337 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 11 msec 2023-07-24 17:07:46,338 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 17:07:46,339 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1690219066339 2023-07-24 17:07:46,358 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,359 INFO [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-24 17:07:46,359 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:07:46,360 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-24 17:07:46,360 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-24 17:07:46,360 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,360 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,362 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:07:46,362 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:07:46,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:07:46,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:07:46,362 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:07:46,362 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:07:46,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:07:46,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:07:46,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:07:46,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:07:46,362 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:07:46,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,362 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:07:46,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,363 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,363 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:07:46,363 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 17:07:46,363 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,363 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-24 17:07:46,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,363 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 17:07:46,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-24 17:07:46,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-24 17:07:46,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,364 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 17:07:46,364 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 17:07:46,364 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,364 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 17:07:46,364 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:07:46,364 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,364 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,367 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 17:07:46,367 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 17:07:46,368 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:07:46,367 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 17:07:46,368 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-24 17:07:46,368 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 17:07:46,369 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-24 17:07:46,368 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:07:46,369 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43483,1690218390174' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-24 17:07:46,368 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37115,1690218390225' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-24 17:07:46,372 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 17:07:46,372 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-24 17:07:46,372 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44109,1690218390103' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-24 17:07:46,379 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:07:46,379 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,379 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:07:46,379 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:07:46,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:07:46,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:07:46,379 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,380 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,380 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:07:46,380 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,380 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:07:46,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:07:46,384 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,384 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:07:46,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:07:46,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:07:46,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:07:46,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:07:46,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:07:46,386 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37115,1690218390225' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-24 17:07:46,386 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2e9292e1[Count = 1] remaining members to acquire global barrier 2023-07-24 17:07:46,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:07:46,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:07:46,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:07:46,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:07:46,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:07:46,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:07:46,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:07:46,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:07:46,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:07:46,396 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44109,1690218390103' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-24 17:07:46,397 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2e9292e1[Count = 0] remaining members to acquire global barrier 2023-07-24 17:07:46,397 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-24 17:07:46,397 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,398 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,399 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 17:07:46,399 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:07:46,399 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:07:46,399 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 17:07:46,398 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,399 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,400 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 17:07:46,400 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 17:07:46,400 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-24 17:07:46,400 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43483,1690218390174' in zk 2023-07-24 17:07:46,403 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 17:07:46,403 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 17:07:46,403 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 17:07:46,403 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 17:07:46,403 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1690218465635.ed0fd81d2214a38a5e750d5f574b2ce4. 2023-07-24 17:07:46,403 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1690218465635.e4bdebdc25a87c2d5b750501e0ad1d40. 2023-07-24 17:07:46,403 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1690218465635.ed0fd81d2214a38a5e750d5f574b2ce4. started... 2023-07-24 17:07:46,403 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1690218465635.e4bdebdc25a87c2d5b750501e0ad1d40. started... 2023-07-24 17:07:46,405 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 17:07:46,405 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ed0fd81d2214a38a5e750d5f574b2ce4: 2023-07-24 17:07:46,405 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:07:46,405 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e4bdebdc25a87c2d5b750501e0ad1d40: 2023-07-24 17:07:46,405 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-24 17:07:46,406 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1690218465635.ed0fd81d2214a38a5e750d5f574b2ce4.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,406 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1690218465635.e4bdebdc25a87c2d5b750501e0ad1d40.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,407 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 17:07:46,407 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 17:07:46,407 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 17:07:46,407 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 17:07:46,427 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1690218465635.e4bdebdc25a87c2d5b750501e0ad1d40. completed. 2023-07-24 17:07:46,427 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1690218465635.e4bdebdc25a87c2d5b750501e0ad1d40. 2023-07-24 17:07:46,427 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 17:07:46,427 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 17:07:46,427 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:07:46,427 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-24 17:07:46,427 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37115,1690218390225' in zk 2023-07-24 17:07:46,429 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 17:07:46,429 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:07:46,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:07:46,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:07:46,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:07:46,429 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:07:46,429 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-24 17:07:46,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:07:46,431 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1690218465635.ed0fd81d2214a38a5e750d5f574b2ce4. completed. 2023-07-24 17:07:46,431 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1690218465635.ed0fd81d2214a38a5e750d5f574b2ce4. 2023-07-24 17:07:46,431 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 17:07:46,431 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 17:07:46,431 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:07:46,431 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-24 17:07:46,431 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,44109,1690218390103' in zk 2023-07-24 17:07:46,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:07:46,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,435 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:07:46,435 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 17:07:46,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:07:46,435 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:07:46,435 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:07:46,435 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-24 17:07:46,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:07:46,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:07:46,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-24 17:07:46,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:07:46,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-24 17:07:46,438 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 17:07:46,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:07:46,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:07:46,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:07:46,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,37115,1690218390225': 2023-07-24 17:07:46,439 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37115,1690218390225' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-24 17:07:46,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:07:46,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:07:46,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:07:46,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:07:46,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:07:46,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:07:46,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:07:46,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:07:46,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:07:46,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:07:46,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:07:46,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:07:46,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,44109,1690218390103': 2023-07-24 17:07:46,444 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44109,1690218390103' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-24 17:07:46,444 INFO [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-24 17:07:46,444 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 17:07:46,444 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 17:07:46,444 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,444 INFO [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 17:07:46,446 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,446 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,446 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,446 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,446 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:07:46,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,446 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:07:46,446 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:07:46,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:07:46,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:07:46,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:07:46,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:07:46,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:07:46,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:07:46,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:07:46,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:07:46,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:07:46,449 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:07:46,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,449 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:07:46,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:07:46,450 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:07:46,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:07:46,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:07:46,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:07:46,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:07:46,452 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:07:46,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,452 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:07:46,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:07:46,453 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:07:46,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:07:46,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:07:46,456 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:07:46,456 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:07:46,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:07:46,456 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:07:46,456 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:07:46,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:07:46,456 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:07:46,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:07:46,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:07:46,456 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:07:46,456 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,456 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:07:46,458 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,458 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:07:46,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:07:46,458 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:07:46,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:07:46,458 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:07:46,458 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,459 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:07:46,459 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:07:46,459 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,459 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:07:46,459 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,459 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:07:46,459 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:07:46,459 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,459 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,459 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:07:46,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:07:46,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:07:46,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:07:46,501 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,543 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-24 17:07:46,544 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,544 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,544 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1690218466333Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1690218466458 (+125 ms)Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1690218466458Writing data manifest for emptySnaptb0-testConsecutiveExports at 1690218466463 (+5 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1690218466477 (+14 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1690218466543 (+66 ms) 2023-07-24 17:07:46,549 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 17:07:46,552 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 215 msec 2023-07-24 17:07:46,638 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:07:46,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-24 17:07:46,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 17:07:46,657 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37115] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1690218465635.e4bdebdc25a87c2d5b750501e0ad1d40. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 17:07:46,659 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44109] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1690218465635.ed0fd81d2214a38a5e750d5f574b2ce4. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 17:07:46,666 DEBUG [Listener at jenkins-hbase4.apache.org/34881] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-24 17:07:46,666 DEBUG [Listener at jenkins-hbase4.apache.org/34881] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1690218465635.e4bdebdc25a87c2d5b750501e0ad1d40. 2023-07-24 17:07:46,668 INFO [Listener at jenkins-hbase4.apache.org/34881] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 17:07:46,681 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 17:07:46,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690218466681 (current time:1690218466681). 2023-07-24 17:07:46,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 17:07:46,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(139): Connect 0x26d506c1 to 127.0.0.1:49884 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:07:46,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@60147514, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:07:46,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:07:46,699 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46534, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:07:46,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x26d506c1 to 127.0.0.1:49884 2023-07-24 17:07:46,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:07:46,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(139): Connect 0x74062841 to 127.0.0.1:49884 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:07:46,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7a6bcb0e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:07:46,719 DEBUG [hconnection-0x3914bd82-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:07:46,723 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46536, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:07:46,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x74062841 to 127.0.0.1:49884 2023-07-24 17:07:46,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:07:46,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-24 17:07:46,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 17:07:46,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 17:07:46,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 17:07:46,737 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 17:07:46,738 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1690219066738 2023-07-24 17:07:46,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 17:07:46,738 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-24 17:07:46,743 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 17:07:46,743 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 17:07:46,746 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 17:07:46,747 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 17:07:46,752 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 12 msec 2023-07-24 17:07:46,753 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 17:07:46,755 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1690219066755 2023-07-24 17:07:46,777 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-24 17:07:46,777 INFO [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-24 17:07:46,778 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:07:46,779 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-24 17:07:46,780 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-24 17:07:46,838 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 17:07:46,838 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 17:07:46,840 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:07:46,840 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:07:46,840 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:07:46,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:07:46,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:07:46,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:07:46,840 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:07:46,840 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:07:46,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:07:46,840 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:07:46,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:07:46,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:07:46,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 17:07:46,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 17:07:46,843 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:07:46,843 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:07:46,844 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 17:07:46,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 17:07:46,844 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 17:07:46,844 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 17:07:46,844 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 17:07:46,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-24 17:07:46,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-24 17:07:46,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-24 17:07:46,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-24 17:07:46,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 17:07:46,845 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 17:07:46,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-24 17:07:46,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 17:07:46,845 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 17:07:46,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 17:07:46,846 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 17:07:46,845 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 17:07:46,846 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-24 17:07:46,846 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 17:07:46,846 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:07:46,847 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-24 17:07:46,847 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 17:07:46,849 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:07:46,849 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-24 17:07:46,849 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 17:07:46,853 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 17:07:46,853 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:07:46,853 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-24 17:07:46,851 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 17:07:46,853 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-24 17:07:46,853 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43483,1690218390174' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-24 17:07:46,853 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44109,1690218390103' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-24 17:07:46,855 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 17:07:46,855 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-24 17:07:46,856 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37115,1690218390225' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-24 17:07:46,856 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 17:07:46,856 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 17:07:46,856 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:07:46,857 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 17:07:46,857 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 17:07:46,857 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:07:46,859 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:07:46,859 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:07:46,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:07:46,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:07:46,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:07:46,861 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 17:07:46,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:07:46,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:07:46,861 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 17:07:46,861 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:07:46,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 17:07:46,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:07:46,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:07:46,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:07:46,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:07:46,866 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44109,1690218390103' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-24 17:07:46,866 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@113d2de8[Count = 1] remaining members to acquire global barrier 2023-07-24 17:07:46,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:07:46,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:07:46,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:07:46,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:07:46,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:07:46,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 17:07:46,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:07:46,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:07:46,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:07:46,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:07:46,874 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37115,1690218390225' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-24 17:07:46,874 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@113d2de8[Count = 0] remaining members to acquire global barrier 2023-07-24 17:07:46,874 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-24 17:07:46,875 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 17:07:46,876 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 17:07:46,876 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 17:07:46,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 17:07:46,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 17:07:46,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 17:07:46,876 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 17:07:46,876 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 17:07:46,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 17:07:46,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 17:07:46,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 17:07:46,877 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 17:07:46,877 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 17:07:46,876 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-24 17:07:46,877 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43483,1690218390174' in zk 2023-07-24 17:07:46,877 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:07:46,878 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:07:46,878 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 17:07:46,878 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 17:07:46,878 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 17:07:46,878 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1690218465635.e4bdebdc25a87c2d5b750501e0ad1d40. 2023-07-24 17:07:46,878 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1690218465635.e4bdebdc25a87c2d5b750501e0ad1d40. started... 2023-07-24 17:07:46,878 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 17:07:46,878 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 17:07:46,878 INFO [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e4bdebdc25a87c2d5b750501e0ad1d40 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-24 17:07:46,879 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 17:07:46,879 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1690218465635.ed0fd81d2214a38a5e750d5f574b2ce4. 2023-07-24 17:07:46,880 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:07:46,880 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1690218465635.ed0fd81d2214a38a5e750d5f574b2ce4. started... 2023-07-24 17:07:46,880 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-24 17:07:46,880 INFO [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ed0fd81d2214a38a5e750d5f574b2ce4 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-24 17:07:46,947 INFO [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.93 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testConsecutiveExports/ed0fd81d2214a38a5e750d5f574b2ce4/.tmp/cf/1f0c2ad87876481eb0887e06b2fa5819 2023-07-24 17:07:46,952 INFO [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=333 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testConsecutiveExports/e4bdebdc25a87c2d5b750501e0ad1d40/.tmp/cf/e62e08f5efed49b28e3b49ad2ee5ae54 2023-07-24 17:07:46,959 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testConsecutiveExports/ed0fd81d2214a38a5e750d5f574b2ce4/.tmp/cf/1f0c2ad87876481eb0887e06b2fa5819 as hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testConsecutiveExports/ed0fd81d2214a38a5e750d5f574b2ce4/cf/1f0c2ad87876481eb0887e06b2fa5819 2023-07-24 17:07:46,964 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testConsecutiveExports/e4bdebdc25a87c2d5b750501e0ad1d40/.tmp/cf/e62e08f5efed49b28e3b49ad2ee5ae54 as hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testConsecutiveExports/e4bdebdc25a87c2d5b750501e0ad1d40/cf/e62e08f5efed49b28e3b49ad2ee5ae54 2023-07-24 17:07:46,972 INFO [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testConsecutiveExports/ed0fd81d2214a38a5e750d5f574b2ce4/cf/1f0c2ad87876481eb0887e06b2fa5819, entries=45, sequenceid=6, filesize=7.9 K 2023-07-24 17:07:46,974 INFO [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for ed0fd81d2214a38a5e750d5f574b2ce4 in 94ms, sequenceid=6, compaction requested=false 2023-07-24 17:07:46,974 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-24 17:07:46,975 INFO [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testConsecutiveExports/e4bdebdc25a87c2d5b750501e0ad1d40/cf/e62e08f5efed49b28e3b49ad2ee5ae54, entries=5, sequenceid=6, filesize=5.2 K 2023-07-24 17:07:46,976 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ed0fd81d2214a38a5e750d5f574b2ce4: 2023-07-24 17:07:46,976 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1690218465635.ed0fd81d2214a38a5e750d5f574b2ce4.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-24 17:07:46,977 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 17:07:46,977 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testConsecutiveExports/ed0fd81d2214a38a5e750d5f574b2ce4/cf/1f0c2ad87876481eb0887e06b2fa5819] hfiles 2023-07-24 17:07:46,977 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testConsecutiveExports/ed0fd81d2214a38a5e750d5f574b2ce4/cf/1f0c2ad87876481eb0887e06b2fa5819 for snapshot=snaptb0-testConsecutiveExports 2023-07-24 17:07:46,977 INFO [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for e4bdebdc25a87c2d5b750501e0ad1d40 in 99ms, sequenceid=6, compaction requested=false 2023-07-24 17:07:46,979 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e4bdebdc25a87c2d5b750501e0ad1d40: 2023-07-24 17:07:46,980 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1690218465635.e4bdebdc25a87c2d5b750501e0ad1d40.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-24 17:07:46,980 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 17:07:46,980 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testConsecutiveExports/e4bdebdc25a87c2d5b750501e0ad1d40/cf/e62e08f5efed49b28e3b49ad2ee5ae54] hfiles 2023-07-24 17:07:46,980 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testConsecutiveExports/e4bdebdc25a87c2d5b750501e0ad1d40/cf/e62e08f5efed49b28e3b49ad2ee5ae54 for snapshot=snaptb0-testConsecutiveExports 2023-07-24 17:07:47,045 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:07:47,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-24 17:07:47,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-24 17:07:47,047 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 17:07:47,062 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1690218465635.ed0fd81d2214a38a5e750d5f574b2ce4. completed. 2023-07-24 17:07:47,062 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1690218465635.ed0fd81d2214a38a5e750d5f574b2ce4. 2023-07-24 17:07:47,062 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 17:07:47,062 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 17:07:47,062 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:07:47,062 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-24 17:07:47,063 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,44109,1690218390103' in zk 2023-07-24 17:07:47,065 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:07:47,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:07:47,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:07:47,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:07:47,066 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 17:07:47,066 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:07:47,066 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-24 17:07:47,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:07:47,067 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1690218465635.e4bdebdc25a87c2d5b750501e0ad1d40. completed. 2023-07-24 17:07:47,067 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1690218465635.e4bdebdc25a87c2d5b750501e0ad1d40. 2023-07-24 17:07:47,067 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 17:07:47,068 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 17:07:47,068 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:07:47,068 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-24 17:07:47,068 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37115,1690218390225' in zk 2023-07-24 17:07:47,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:07:47,069 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 17:07:47,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 17:07:47,070 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:07:47,070 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:07:47,070 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-24 17:07:47,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:07:47,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:07:47,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:07:47,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:07:47,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 17:07:47,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:07:47,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:07:47,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:07:47,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,44109,1690218390103': 2023-07-24 17:07:47,077 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44109,1690218390103' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-24 17:07:47,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:07:47,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:07:47,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:07:47,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:07:47,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:07:47,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 17:07:47,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:07:47,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:07:47,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:07:47,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:07:47,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 17:07:47,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:07:47,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:07:47,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:07:47,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,37115,1690218390225': 2023-07-24 17:07:47,082 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37115,1690218390225' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-24 17:07:47,082 INFO [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-24 17:07:47,082 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 17:07:47,082 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 17:07:47,082 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-24 17:07:47,082 INFO [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 17:07:47,091 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,091 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,091 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,091 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:07:47,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,091 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,092 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:07:47,092 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:07:47,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:07:47,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:07:47,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:07:47,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:07:47,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:07:47,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:07:47,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,092 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:07:47,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:07:47,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:07:47,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:07:47,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,093 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:07:47,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 17:07:47,094 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:07:47,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:07:47,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 17:07:47,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:07:47,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:07:47,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:07:47,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:07:47,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 17:07:47,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:07:47,099 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:07:47,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:07:47,100 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:07:47,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:07:47,100 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:07:47,104 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:07:47,104 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:07:47,104 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:07:47,104 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:07:47,104 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-24 17:07:47,104 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-24 17:07:47,104 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:07:47,106 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:07:47,106 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,104 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:07:47,104 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:07:47,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:07:47,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:07:47,106 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:07:47,106 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:07:47,107 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,107 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:07:47,107 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:07:47,107 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,107 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:07:47,104 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:07:47,107 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:07:47,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:07:47,107 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:07:47,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:07:47,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:07:47,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:07:47,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:07:47,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:07:47,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:07:47,151 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,180 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-24 17:07:47,180 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,181 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,181 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1690218466738Consolidate snapshot: snaptb0-testConsecutiveExports at 1690218467104 (+366 ms)Loading Region manifests for snaptb0-testConsecutiveExports at 1690218467104Writing data manifest for snaptb0-testConsecutiveExports at 1690218467113 (+9 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1690218467139 (+26 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1690218467180 (+41 ms) 2023-07-24 17:07:47,184 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 17:07:47,187 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 444 msec 2023-07-24 17:07:47,347 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:07:47,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-24 17:07:47,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 17:07:47,349 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/local-export-1690218467349 2023-07-24 17:07:47,349 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/local-export-1690218467349, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/local-export-1690218467349, srcFsUri=hdfs://localhost:41733, srcDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d 2023-07-24 17:07:47,371 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:41733, inputRoot=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d 2023-07-24 17:07:47,371 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@15a50b83, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/local-export-1690218467349, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/local-export-1690218467349/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,372 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:41733, inputRoot=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d, snapshotDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-24 17:07:47,380 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/local-export-1690218467349/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,391 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 17:07:47,392 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 17:07:47,392 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 17:07:47,392 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 17:07:47,393 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-24 17:07:47,393 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 17:07:47,393 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 17:07:47,464 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/hadoop-3694918876139151210.jar 2023-07-24 17:07:47,464 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 17:07:47,465 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 17:07:47,465 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 17:07:47,465 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 17:07:47,466 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 17:07:47,466 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 17:07:47,466 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 17:07:47,467 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 17:07:47,467 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 17:07:47,468 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 17:07:47,468 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 17:07:47,468 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 17:07:47,469 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 17:07:47,469 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 17:07:47,469 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 17:07:47,470 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 17:07:47,470 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 17:07:47,471 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 17:07:47,471 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 17:07:47,471 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 17:07:47,471 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 17:07:47,472 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 17:07:47,472 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 17:07:47,962 WARN [Listener at jenkins-hbase4.apache.org/34881] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 17:07:47,964 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-24 17:07:47,966 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-24 17:07:49,996 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 17:07:49,996 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 17:07:50,006 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397910_0002_000001 (auth:SIMPLE) 2023-07-24 17:07:50,522 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397910_0003_000001 (auth:SIMPLE) 2023-07-24 17:07:50,930 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 17:07:57,564 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397910_0003_000001 (auth:SIMPLE) 2023-07-24 17:07:59,898 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397910_0003_000001 (auth:SIMPLE) 2023-07-24 17:08:04,346 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397910_0003_000001 (auth:SIMPLE) 2023-07-24 17:08:06,186 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 17:08:06,187 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 17:08:06,191 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-24 17:08:06,191 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 17:08:06,191 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 17:08:06,191 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-789691247_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 17:08:06,192 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(367): hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-24 17:08:06,192 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(367): hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-24 17:08:06,192 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@625cdb88 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/local-export-1690218467349/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/local-export-1690218467349/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 17:08:06,193 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/local-export-1690218467349/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-24 17:08:06,193 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/local-export-1690218467349/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-24 17:08:06,195 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/local-export-1690218467349, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/local-export-1690218467349, srcFsUri=hdfs://localhost:41733, srcDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d 2023-07-24 17:08:06,218 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:41733, inputRoot=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d 2023-07-24 17:08:06,218 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@26e0026b, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/local-export-1690218467349, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/local-export-1690218467349/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 17:08:06,218 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:41733, inputRoot=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d, snapshotDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-24 17:08:06,231 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/local-export-1690218467349/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 17:08:06,245 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:06,246 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:06,246 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:06,247 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:06,247 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:06,247 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:06,248 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:06,341 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/hadoop-8198421712427357334.jar 2023-07-24 17:08:06,342 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:06,342 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:06,343 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:06,343 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:06,344 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:06,344 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:06,344 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 17:08:06,345 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 17:08:06,345 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 17:08:06,345 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 17:08:06,346 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 17:08:06,346 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 17:08:06,347 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 17:08:06,347 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 17:08:06,348 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 17:08:06,348 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 17:08:06,349 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 17:08:06,350 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 17:08:06,350 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 17:08:06,351 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 17:08:06,351 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 17:08:06,351 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 17:08:06,352 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 17:08:06,889 WARN [Listener at jenkins-hbase4.apache.org/34881] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 17:08:06,892 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-24 17:08:06,894 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-24 17:08:10,555 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 17:08:10,555 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 17:08:10,568 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397910_0003_000001 (auth:SIMPLE) 2023-07-24 17:08:11,322 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397910_0004_000001 (auth:SIMPLE) 2023-07-24 17:08:18,107 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397910_0004_000001 (auth:SIMPLE) 2023-07-24 17:08:20,430 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397910_0004_000001 (auth:SIMPLE) 2023-07-24 17:08:23,807 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397910_0004_000001 (auth:SIMPLE) 2023-07-24 17:08:25,137 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 17:08:25,137 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 17:08:25,142 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-24 17:08:25,142 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 17:08:25,143 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 17:08:25,143 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-789691247_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 17:08:25,146 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(367): hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-24 17:08:25,147 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(367): hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-24 17:08:25,147 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@625cdb88 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/local-export-1690218467349/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/local-export-1690218467349/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 17:08:25,147 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/local-export-1690218467349/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-24 17:08:25,147 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/local-export-1690218467349/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-24 17:08:25,160 INFO [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-24 17:08:25,162 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-24 17:08:25,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-24 17:08:25,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-24 17:08:25,168 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218505168"}]},"ts":"1690218505168"} 2023-07-24 17:08:25,170 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-24 17:08:25,173 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-24 17:08:25,175 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=e4bdebdc25a87c2d5b750501e0ad1d40, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ed0fd81d2214a38a5e750d5f574b2ce4, UNASSIGN}] 2023-07-24 17:08:25,178 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ed0fd81d2214a38a5e750d5f574b2ce4, UNASSIGN 2023-07-24 17:08:25,178 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=e4bdebdc25a87c2d5b750501e0ad1d40, UNASSIGN 2023-07-24 17:08:25,179 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=ed0fd81d2214a38a5e750d5f574b2ce4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:08:25,179 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=e4bdebdc25a87c2d5b750501e0ad1d40, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:25,180 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1690218465635.ed0fd81d2214a38a5e750d5f574b2ce4.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690218505179"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218505179"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218505179"}]},"ts":"1690218505179"} 2023-07-24 17:08:25,180 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1690218465635.e4bdebdc25a87c2d5b750501e0ad1d40.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690218505179"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218505179"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218505179"}]},"ts":"1690218505179"} 2023-07-24 17:08:25,181 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure ed0fd81d2214a38a5e750d5f574b2ce4, server=jenkins-hbase4.apache.org,44109,1690218390103}] 2023-07-24 17:08:25,184 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure e4bdebdc25a87c2d5b750501e0ad1d40, server=jenkins-hbase4.apache.org,37115,1690218390225}] 2023-07-24 17:08:25,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-24 17:08:25,338 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ed0fd81d2214a38a5e750d5f574b2ce4 2023-07-24 17:08:25,338 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ed0fd81d2214a38a5e750d5f574b2ce4, disabling compactions & flushes 2023-07-24 17:08:25,338 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1690218465635.ed0fd81d2214a38a5e750d5f574b2ce4. 2023-07-24 17:08:25,338 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1690218465635.ed0fd81d2214a38a5e750d5f574b2ce4. 2023-07-24 17:08:25,338 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1690218465635.ed0fd81d2214a38a5e750d5f574b2ce4. after waiting 0 ms 2023-07-24 17:08:25,338 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1690218465635.ed0fd81d2214a38a5e750d5f574b2ce4. 2023-07-24 17:08:25,368 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e4bdebdc25a87c2d5b750501e0ad1d40 2023-07-24 17:08:25,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e4bdebdc25a87c2d5b750501e0ad1d40, disabling compactions & flushes 2023-07-24 17:08:25,368 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1690218465635.e4bdebdc25a87c2d5b750501e0ad1d40. 2023-07-24 17:08:25,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1690218465635.e4bdebdc25a87c2d5b750501e0ad1d40. 2023-07-24 17:08:25,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1690218465635.e4bdebdc25a87c2d5b750501e0ad1d40. after waiting 0 ms 2023-07-24 17:08:25,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1690218465635.e4bdebdc25a87c2d5b750501e0ad1d40. 2023-07-24 17:08:25,419 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testConsecutiveExports/ed0fd81d2214a38a5e750d5f574b2ce4/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 17:08:25,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 17:08:25,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testConsecutiveExports/e4bdebdc25a87c2d5b750501e0ad1d40/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 17:08:25,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 17:08:25,424 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1690218465635.e4bdebdc25a87c2d5b750501e0ad1d40. 2023-07-24 17:08:25,424 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e4bdebdc25a87c2d5b750501e0ad1d40: 2023-07-24 17:08:25,424 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1690218465635.ed0fd81d2214a38a5e750d5f574b2ce4. 2023-07-24 17:08:25,424 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ed0fd81d2214a38a5e750d5f574b2ce4: 2023-07-24 17:08:25,426 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e4bdebdc25a87c2d5b750501e0ad1d40 2023-07-24 17:08:25,427 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ed0fd81d2214a38a5e750d5f574b2ce4 2023-07-24 17:08:25,427 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=e4bdebdc25a87c2d5b750501e0ad1d40, regionState=CLOSED 2023-07-24 17:08:25,428 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1690218465635.e4bdebdc25a87c2d5b750501e0ad1d40.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690218505427"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218505427"}]},"ts":"1690218505427"} 2023-07-24 17:08:25,428 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=ed0fd81d2214a38a5e750d5f574b2ce4, regionState=CLOSED 2023-07-24 17:08:25,428 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1690218465635.ed0fd81d2214a38a5e750d5f574b2ce4.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690218505428"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218505428"}]},"ts":"1690218505428"} 2023-07-24 17:08:25,442 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-24 17:08:25,442 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure e4bdebdc25a87c2d5b750501e0ad1d40, server=jenkins-hbase4.apache.org,37115,1690218390225 in 253 msec 2023-07-24 17:08:25,444 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-24 17:08:25,444 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure ed0fd81d2214a38a5e750d5f574b2ce4, server=jenkins-hbase4.apache.org,44109,1690218390103 in 257 msec 2023-07-24 17:08:25,445 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=e4bdebdc25a87c2d5b750501e0ad1d40, UNASSIGN in 268 msec 2023-07-24 17:08:25,447 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-24 17:08:25,447 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ed0fd81d2214a38a5e750d5f574b2ce4, UNASSIGN in 269 msec 2023-07-24 17:08:25,449 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218505448"}]},"ts":"1690218505448"} 2023-07-24 17:08:25,451 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-24 17:08:25,457 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-24 17:08:25,462 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 296 msec 2023-07-24 17:08:25,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-24 17:08:25,472 INFO [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-24 17:08:25,473 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-24 17:08:25,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 17:08:25,477 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 17:08:25,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-24 17:08:25,478 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 17:08:25,481 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37115] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-24 17:08:25,486 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 17:08:25,486 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 17:08:25,486 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 17:08:25,486 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 17:08:25,487 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testConsecutiveExports/e4bdebdc25a87c2d5b750501e0ad1d40 2023-07-24 17:08:25,487 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-24 17:08:25,487 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-24 17:08:25,487 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-24 17:08:25,487 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-24 17:08:25,489 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 17:08:25,489 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:08:25,489 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 17:08:25,489 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:08:25,490 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 17:08:25,490 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:08:25,490 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 17:08:25,490 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:08:25,491 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testConsecutiveExports/e4bdebdc25a87c2d5b750501e0ad1d40/cf, FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testConsecutiveExports/e4bdebdc25a87c2d5b750501e0ad1d40/recovered.edits] 2023-07-24 17:08:25,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-24 17:08:25,499 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testConsecutiveExports/ed0fd81d2214a38a5e750d5f574b2ce4 2023-07-24 17:08:25,505 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testConsecutiveExports/ed0fd81d2214a38a5e750d5f574b2ce4/cf, FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testConsecutiveExports/ed0fd81d2214a38a5e750d5f574b2ce4/recovered.edits] 2023-07-24 17:08:25,510 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testConsecutiveExports/e4bdebdc25a87c2d5b750501e0ad1d40/cf/e62e08f5efed49b28e3b49ad2ee5ae54 to hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/archive/data/default/testtb-testConsecutiveExports/e4bdebdc25a87c2d5b750501e0ad1d40/cf/e62e08f5efed49b28e3b49ad2ee5ae54 2023-07-24 17:08:25,512 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testConsecutiveExports/ed0fd81d2214a38a5e750d5f574b2ce4/cf/1f0c2ad87876481eb0887e06b2fa5819 to hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/archive/data/default/testtb-testConsecutiveExports/ed0fd81d2214a38a5e750d5f574b2ce4/cf/1f0c2ad87876481eb0887e06b2fa5819 2023-07-24 17:08:25,516 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testConsecutiveExports/ed0fd81d2214a38a5e750d5f574b2ce4/recovered.edits/9.seqid to hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/archive/data/default/testtb-testConsecutiveExports/ed0fd81d2214a38a5e750d5f574b2ce4/recovered.edits/9.seqid 2023-07-24 17:08:25,517 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testConsecutiveExports/ed0fd81d2214a38a5e750d5f574b2ce4 2023-07-24 17:08:25,528 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testConsecutiveExports/e4bdebdc25a87c2d5b750501e0ad1d40/recovered.edits/9.seqid to hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/archive/data/default/testtb-testConsecutiveExports/e4bdebdc25a87c2d5b750501e0ad1d40/recovered.edits/9.seqid 2023-07-24 17:08:25,528 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testConsecutiveExports/e4bdebdc25a87c2d5b750501e0ad1d40 2023-07-24 17:08:25,529 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-24 17:08:25,532 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 17:08:25,534 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-24 17:08:25,537 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-24 17:08:25,539 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 17:08:25,539 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-24 17:08:25,539 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1690218465635.e4bdebdc25a87c2d5b750501e0ad1d40.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690218505539"}]},"ts":"9223372036854775807"} 2023-07-24 17:08:25,539 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1690218465635.ed0fd81d2214a38a5e750d5f574b2ce4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690218505539"}]},"ts":"9223372036854775807"} 2023-07-24 17:08:25,546 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 17:08:25,546 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e4bdebdc25a87c2d5b750501e0ad1d40, NAME => 'testtb-testConsecutiveExports,,1690218465635.e4bdebdc25a87c2d5b750501e0ad1d40.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => ed0fd81d2214a38a5e750d5f574b2ce4, NAME => 'testtb-testConsecutiveExports,1,1690218465635.ed0fd81d2214a38a5e750d5f574b2ce4.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 17:08:25,546 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-24 17:08:25,546 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690218505546"}]},"ts":"9223372036854775807"} 2023-07-24 17:08:25,557 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-24 17:08:25,559 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 17:08:25,564 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 86 msec 2023-07-24 17:08:25,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-24 17:08:25,594 INFO [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-24 17:08:25,611 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-24 17:08:25,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-24 17:08:25,615 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-24 17:08:25,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-24 17:08:25,655 INFO [Listener at jenkins-hbase4.apache.org/34881] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=745 (was 736) Potentially hanging thread: hconnection-0x6b0b3732-shared-pool-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1284875502_1 at /127.0.0.1:49340 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-14 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-789691247_17 at /127.0.0.1:44558 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1284875502_1 at /127.0.0.1:37350 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-789691247_17 at /127.0.0.1:37376 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6b0b3732-shared-pool-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1822682432) connection to jenkins-hbase4.apache.org/172.31.14.131:45849 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x6b0b3732-shared-pool-24 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-13 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6b0b3732-shared-pool-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3186 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) - Thread LEAK? -, OpenFileDescriptor=892 (was 896), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=511 (was 151) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 179) - ProcessCount LEAK? -, AvailableMemoryMB=4860 (was 5780) 2023-07-24 17:08:25,656 WARN [Listener at jenkins-hbase4.apache.org/34881] hbase.ResourceChecker(130): Thread=745 is superior to 500 2023-07-24 17:08:25,684 INFO [Listener at jenkins-hbase4.apache.org/34881] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=745, OpenFileDescriptor=892, MaxFileDescriptor=60000, SystemLoadAverage=511, ProcessCount=181, AvailableMemoryMB=4858 2023-07-24 17:08:25,684 WARN [Listener at jenkins-hbase4.apache.org/34881] hbase.ResourceChecker(130): Thread=745 is superior to 500 2023-07-24 17:08:25,686 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46651] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-24 17:08:25,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,691 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 17:08:25,692 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46651] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-24 17:08:25,692 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 17:08:25,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-24 17:08:25,695 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1470aa8eedfe37b6836860ac245f3204 2023-07-24 17:08:25,696 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/4f6ce1604d7263e93b3764c8a3e39ed9 2023-07-24 17:08:25,697 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1470aa8eedfe37b6836860ac245f3204 empty. 2023-07-24 17:08:25,698 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/4f6ce1604d7263e93b3764c8a3e39ed9 empty. 2023-07-24 17:08:25,698 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1470aa8eedfe37b6836860ac245f3204 2023-07-24 17:08:25,698 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/4f6ce1604d7263e93b3764c8a3e39ed9 2023-07-24 17:08:25,698 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-24 17:08:25,722 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-24 17:08:25,723 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1470aa8eedfe37b6836860ac245f3204, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690218505686.1470aa8eedfe37b6836860ac245f3204.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp 2023-07-24 17:08:25,724 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 4f6ce1604d7263e93b3764c8a3e39ed9, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690218505686.4f6ce1604d7263e93b3764c8a3e39ed9.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp 2023-07-24 17:08:25,762 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1690218505686.1470aa8eedfe37b6836860ac245f3204.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:08:25,762 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 1470aa8eedfe37b6836860ac245f3204, disabling compactions & flushes 2023-07-24 17:08:25,762 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1690218505686.1470aa8eedfe37b6836860ac245f3204. 2023-07-24 17:08:25,762 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690218505686.1470aa8eedfe37b6836860ac245f3204. 2023-07-24 17:08:25,762 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690218505686.1470aa8eedfe37b6836860ac245f3204. after waiting 0 ms 2023-07-24 17:08:25,762 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1690218505686.1470aa8eedfe37b6836860ac245f3204. 2023-07-24 17:08:25,762 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1690218505686.1470aa8eedfe37b6836860ac245f3204. 2023-07-24 17:08:25,762 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 1470aa8eedfe37b6836860ac245f3204: 2023-07-24 17:08:25,766 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1690218505686.4f6ce1604d7263e93b3764c8a3e39ed9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:08:25,767 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 4f6ce1604d7263e93b3764c8a3e39ed9, disabling compactions & flushes 2023-07-24 17:08:25,767 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1690218505686.4f6ce1604d7263e93b3764c8a3e39ed9. 2023-07-24 17:08:25,767 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690218505686.4f6ce1604d7263e93b3764c8a3e39ed9. 2023-07-24 17:08:25,767 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690218505686.4f6ce1604d7263e93b3764c8a3e39ed9. after waiting 0 ms 2023-07-24 17:08:25,767 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1690218505686.4f6ce1604d7263e93b3764c8a3e39ed9. 2023-07-24 17:08:25,767 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1690218505686.4f6ce1604d7263e93b3764c8a3e39ed9. 2023-07-24 17:08:25,767 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 4f6ce1604d7263e93b3764c8a3e39ed9: 2023-07-24 17:08:25,770 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 17:08:25,774 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690218505686.1470aa8eedfe37b6836860ac245f3204.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690218505774"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218505774"}]},"ts":"1690218505774"} 2023-07-24 17:08:25,774 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690218505686.4f6ce1604d7263e93b3764c8a3e39ed9.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690218505774"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218505774"}]},"ts":"1690218505774"} 2023-07-24 17:08:25,782 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 17:08:25,783 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 17:08:25,783 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218505783"}]},"ts":"1690218505783"} 2023-07-24 17:08:25,785 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-24 17:08:25,788 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 17:08:25,789 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 17:08:25,789 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 17:08:25,790 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 17:08:25,790 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 17:08:25,790 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1470aa8eedfe37b6836860ac245f3204, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=4f6ce1604d7263e93b3764c8a3e39ed9, ASSIGN}] 2023-07-24 17:08:25,793 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1470aa8eedfe37b6836860ac245f3204, ASSIGN 2023-07-24 17:08:25,793 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=4f6ce1604d7263e93b3764c8a3e39ed9, ASSIGN 2023-07-24 17:08:25,793 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1470aa8eedfe37b6836860ac245f3204, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37115,1690218390225; forceNewPlan=false, retain=false 2023-07-24 17:08:25,793 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=4f6ce1604d7263e93b3764c8a3e39ed9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43483,1690218390174; forceNewPlan=false, retain=false 2023-07-24 17:08:25,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-24 17:08:25,944 INFO [jenkins-hbase4:46651] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 17:08:25,947 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=4f6ce1604d7263e93b3764c8a3e39ed9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:25,947 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=1470aa8eedfe37b6836860ac245f3204, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:25,947 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690218505686.1470aa8eedfe37b6836860ac245f3204.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690218505947"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218505947"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218505947"}]},"ts":"1690218505947"} 2023-07-24 17:08:25,947 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690218505686.4f6ce1604d7263e93b3764c8a3e39ed9.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690218505947"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218505947"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218505947"}]},"ts":"1690218505947"} 2023-07-24 17:08:25,949 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 4f6ce1604d7263e93b3764c8a3e39ed9, server=jenkins-hbase4.apache.org,43483,1690218390174}] 2023-07-24 17:08:25,950 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 1470aa8eedfe37b6836860ac245f3204, server=jenkins-hbase4.apache.org,37115,1690218390225}] 2023-07-24 17:08:25,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-24 17:08:26,116 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1690218505686.1470aa8eedfe37b6836860ac245f3204. 2023-07-24 17:08:26,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1470aa8eedfe37b6836860ac245f3204, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690218505686.1470aa8eedfe37b6836860ac245f3204.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 17:08:26,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1690218505686.1470aa8eedfe37b6836860ac245f3204. service=AccessControlService 2023-07-24 17:08:26,117 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 17:08:26,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 1470aa8eedfe37b6836860ac245f3204 2023-07-24 17:08:26,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1690218505686.1470aa8eedfe37b6836860ac245f3204.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:08:26,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1470aa8eedfe37b6836860ac245f3204 2023-07-24 17:08:26,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1470aa8eedfe37b6836860ac245f3204 2023-07-24 17:08:26,123 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1690218505686.4f6ce1604d7263e93b3764c8a3e39ed9. 2023-07-24 17:08:26,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4f6ce1604d7263e93b3764c8a3e39ed9, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690218505686.4f6ce1604d7263e93b3764c8a3e39ed9.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 17:08:26,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1690218505686.4f6ce1604d7263e93b3764c8a3e39ed9. service=AccessControlService 2023-07-24 17:08:26,124 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 17:08:26,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 4f6ce1604d7263e93b3764c8a3e39ed9 2023-07-24 17:08:26,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1690218505686.4f6ce1604d7263e93b3764c8a3e39ed9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:08:26,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4f6ce1604d7263e93b3764c8a3e39ed9 2023-07-24 17:08:26,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4f6ce1604d7263e93b3764c8a3e39ed9 2023-07-24 17:08:26,132 INFO [StoreOpener-1470aa8eedfe37b6836860ac245f3204-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1470aa8eedfe37b6836860ac245f3204 2023-07-24 17:08:26,136 INFO [StoreOpener-4f6ce1604d7263e93b3764c8a3e39ed9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4f6ce1604d7263e93b3764c8a3e39ed9 2023-07-24 17:08:26,136 DEBUG [StoreOpener-1470aa8eedfe37b6836860ac245f3204-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion/1470aa8eedfe37b6836860ac245f3204/cf 2023-07-24 17:08:26,136 DEBUG [StoreOpener-1470aa8eedfe37b6836860ac245f3204-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion/1470aa8eedfe37b6836860ac245f3204/cf 2023-07-24 17:08:26,138 INFO [StoreOpener-1470aa8eedfe37b6836860ac245f3204-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1470aa8eedfe37b6836860ac245f3204 columnFamilyName cf 2023-07-24 17:08:26,145 INFO [StoreOpener-1470aa8eedfe37b6836860ac245f3204-1] regionserver.HStore(310): Store=1470aa8eedfe37b6836860ac245f3204/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 17:08:26,146 DEBUG [StoreOpener-4f6ce1604d7263e93b3764c8a3e39ed9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion/4f6ce1604d7263e93b3764c8a3e39ed9/cf 2023-07-24 17:08:26,146 DEBUG [StoreOpener-4f6ce1604d7263e93b3764c8a3e39ed9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion/4f6ce1604d7263e93b3764c8a3e39ed9/cf 2023-07-24 17:08:26,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion/1470aa8eedfe37b6836860ac245f3204 2023-07-24 17:08:26,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion/1470aa8eedfe37b6836860ac245f3204 2023-07-24 17:08:26,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1470aa8eedfe37b6836860ac245f3204 2023-07-24 17:08:26,155 INFO [StoreOpener-4f6ce1604d7263e93b3764c8a3e39ed9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4f6ce1604d7263e93b3764c8a3e39ed9 columnFamilyName cf 2023-07-24 17:08:26,155 INFO [StoreOpener-4f6ce1604d7263e93b3764c8a3e39ed9-1] regionserver.HStore(310): Store=4f6ce1604d7263e93b3764c8a3e39ed9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 17:08:26,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion/1470aa8eedfe37b6836860ac245f3204/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 17:08:26,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion/4f6ce1604d7263e93b3764c8a3e39ed9 2023-07-24 17:08:26,177 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1470aa8eedfe37b6836860ac245f3204; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61138930, jitterRate=-0.08895894885063171}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 17:08:26,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion/4f6ce1604d7263e93b3764c8a3e39ed9 2023-07-24 17:08:26,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1470aa8eedfe37b6836860ac245f3204: 2023-07-24 17:08:26,179 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1690218505686.1470aa8eedfe37b6836860ac245f3204., pid=61, masterSystemTime=1690218506104 2023-07-24 17:08:26,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1690218505686.1470aa8eedfe37b6836860ac245f3204. 2023-07-24 17:08:26,181 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1690218505686.1470aa8eedfe37b6836860ac245f3204. 2023-07-24 17:08:26,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4f6ce1604d7263e93b3764c8a3e39ed9 2023-07-24 17:08:26,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion/4f6ce1604d7263e93b3764c8a3e39ed9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 17:08:26,187 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=1470aa8eedfe37b6836860ac245f3204, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:26,187 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690218505686.1470aa8eedfe37b6836860ac245f3204.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690218506187"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690218506187"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690218506187"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690218506187"}]},"ts":"1690218506187"} 2023-07-24 17:08:26,189 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4f6ce1604d7263e93b3764c8a3e39ed9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59498334, jitterRate=-0.1134057343006134}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 17:08:26,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4f6ce1604d7263e93b3764c8a3e39ed9: 2023-07-24 17:08:26,190 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1690218505686.4f6ce1604d7263e93b3764c8a3e39ed9., pid=60, masterSystemTime=1690218506102 2023-07-24 17:08:26,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1690218505686.4f6ce1604d7263e93b3764c8a3e39ed9. 2023-07-24 17:08:26,194 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1690218505686.4f6ce1604d7263e93b3764c8a3e39ed9. 2023-07-24 17:08:26,195 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=4f6ce1604d7263e93b3764c8a3e39ed9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:26,196 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690218505686.4f6ce1604d7263e93b3764c8a3e39ed9.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690218506195"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690218506195"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690218506195"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690218506195"}]},"ts":"1690218506195"} 2023-07-24 17:08:26,196 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-24 17:08:26,196 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 1470aa8eedfe37b6836860ac245f3204, server=jenkins-hbase4.apache.org,37115,1690218390225 in 240 msec 2023-07-24 17:08:26,199 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1470aa8eedfe37b6836860ac245f3204, ASSIGN in 406 msec 2023-07-24 17:08:26,204 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-24 17:08:26,204 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 4f6ce1604d7263e93b3764c8a3e39ed9, server=jenkins-hbase4.apache.org,43483,1690218390174 in 250 msec 2023-07-24 17:08:26,207 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-24 17:08:26,208 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=4f6ce1604d7263e93b3764c8a3e39ed9, ASSIGN in 414 msec 2023-07-24 17:08:26,209 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 17:08:26,209 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218506209"}]},"ts":"1690218506209"} 2023-07-24 17:08:26,219 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-24 17:08:26,225 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 17:08:26,226 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-24 17:08:26,228 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37115] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-24 17:08:26,230 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:08:26,230 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:08:26,230 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:08:26,230 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:08:26,233 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 17:08:26,233 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 17:08:26,233 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 17:08:26,234 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 17:08:26,235 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 548 msec 2023-07-24 17:08:26,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-24 17:08:26,298 INFO [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-24 17:08:26,298 DEBUG [Listener at jenkins-hbase4.apache.org/34881] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithMergeRegion get assigned. Timeout = 60000ms 2023-07-24 17:08:26,298 INFO [Listener at jenkins-hbase4.apache.org/34881] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 17:08:26,304 INFO [Listener at jenkins-hbase4.apache.org/34881] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned to meta. Checking AM states. 2023-07-24 17:08:26,304 INFO [Listener at jenkins-hbase4.apache.org/34881] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 17:08:26,304 INFO [Listener at jenkins-hbase4.apache.org/34881] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned. 2023-07-24 17:08:26,310 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46651] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 17:08:26,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46651] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690218506310 (current time:1690218506310). 2023-07-24 17:08:26,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46651] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 17:08:26,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46651] zookeeper.ReadOnlyZKClient(139): Connect 0x1e64595a to 127.0.0.1:49884 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:08:26,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a67da13, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:08:26,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46651] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:08:26,351 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49914, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:08:26,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1e64595a to 127.0.0.1:49884 2023-07-24 17:08:26,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:08:26,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46651] zookeeper.ReadOnlyZKClient(139): Connect 0x42d9999d to 127.0.0.1:49884 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:08:26,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e4ba615, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:08:26,372 DEBUG [hconnection-0x7af84c8d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:08:26,373 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49920, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:08:26,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x42d9999d to 127.0.0.1:49884 2023-07-24 17:08:26,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:08:26,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46651] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-24 17:08:26,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46651] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 17:08:26,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46651] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 17:08:26,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 17:08:26,393 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 17:08:26,394 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1690219106394 2023-07-24 17:08:26,394 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46651] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 17:08:26,397 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 17:08:26,397 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 17:08:26,397 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 17:08:26,398 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 17:08:26,401 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 9 msec 2023-07-24 17:08:26,403 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 17:08:26,403 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1690219106403 2023-07-24 17:08:26,433 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,433 INFO [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-24 17:08:26,433 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:08:26,435 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-24 17:08:26,435 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-24 17:08:26,492 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,492 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,500 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:08:26,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 17:08:26,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46651] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-24 17:08:26,501 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 17:08:26,504 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:26,504 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:26,504 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:26,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:26,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:26,504 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:26,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:26,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:26,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:26,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:26,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,505 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:26,505 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:26,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,506 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:26,506 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,506 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 17:08:26,506 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,506 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-24 17:08:26,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-24 17:08:26,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-24 17:08:26,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,507 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 17:08:26,507 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 17:08:26,507 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 17:08:26,510 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,511 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 17:08:26,511 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:08:26,516 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 17:08:26,516 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 17:08:26,516 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43483,1690218390174' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 17:08:26,523 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:26,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:26,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:08:26,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:08:26,525 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,526 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,527 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:08:26,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:08:26,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:08:26,530 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,530 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,530 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 17:08:26,530 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:08:26,530 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 17:08:26,540 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:08:26,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,540 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 17:08:26,540 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 17:08:26,540 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44109,1690218390103' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 17:08:26,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:26,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:08:26,543 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 17:08:26,543 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 17:08:26,543 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37115,1690218390225' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 17:08:26,545 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,545 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:26,546 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,546 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:08:26,547 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43483,1690218390174' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-24 17:08:26,547 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5e9a3d0a[Count = 1] remaining members to acquire global barrier 2023-07-24 17:08:26,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:26,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:08:26,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:08:26,547 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:08:26,550 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,550 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:08:26,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:08:26,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:08:26,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:26,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:26,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:08:26,552 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37115,1690218390225' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-24 17:08:26,552 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5e9a3d0a[Count = 0] remaining members to acquire global barrier 2023-07-24 17:08:26,552 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-24 17:08:26,553 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,555 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,555 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,555 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,556 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 17:08:26,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,556 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 17:08:26,556 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 17:08:26,556 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 17:08:26,556 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:26,556 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,44109,1690218390103' in zk 2023-07-24 17:08:26,557 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:26,557 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 17:08:26,558 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 17:08:26,558 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 17:08:26,559 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690218505686.1470aa8eedfe37b6836860ac245f3204. 2023-07-24 17:08:26,559 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690218505686.1470aa8eedfe37b6836860ac245f3204. started... 2023-07-24 17:08:26,561 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 17:08:26,561 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:08:26,561 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 17:08:26,563 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 17:08:26,563 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 17:08:26,563 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1470aa8eedfe37b6836860ac245f3204: 2023-07-24 17:08:26,563 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1690218505686.1470aa8eedfe37b6836860ac245f3204.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,564 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 17:08:26,564 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 17:08:26,567 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690218505686.4f6ce1604d7263e93b3764c8a3e39ed9. 2023-07-24 17:08:26,567 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690218505686.4f6ce1604d7263e93b3764c8a3e39ed9. started... 2023-07-24 17:08:26,569 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4f6ce1604d7263e93b3764c8a3e39ed9: 2023-07-24 17:08:26,569 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1690218505686.4f6ce1604d7263e93b3764c8a3e39ed9.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,570 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 17:08:26,570 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 17:08:26,619 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690218505686.1470aa8eedfe37b6836860ac245f3204. completed. 2023-07-24 17:08:26,619 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690218505686.1470aa8eedfe37b6836860ac245f3204. 2023-07-24 17:08:26,619 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 17:08:26,619 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 17:08:26,619 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:26,619 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 17:08:26,619 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37115,1690218390225' in zk 2023-07-24 17:08:26,621 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:26,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:26,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:08:26,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:08:26,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:08:26,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:08:26,623 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 17:08:26,623 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:08:26,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:08:26,623 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 17:08:26,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:26,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:26,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:08:26,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,641 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690218505686.4f6ce1604d7263e93b3764c8a3e39ed9. completed. 2023-07-24 17:08:26,641 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690218505686.4f6ce1604d7263e93b3764c8a3e39ed9. 2023-07-24 17:08:26,641 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 17:08:26,641 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 17:08:26,641 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:26,641 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 17:08:26,641 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43483,1690218390174' in zk 2023-07-24 17:08:26,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:08:26,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:26,643 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 17:08:26,643 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:08:26,643 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 17:08:26,645 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:26,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,37115,1690218390225': 2023-07-24 17:08:26,645 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37115,1690218390225' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-24 17:08:26,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:26,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:08:26,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:08:26,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:08:26,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:08:26,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:08:26,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:26,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:26,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:08:26,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:08:26,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:26,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:26,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,43483,1690218390174': 2023-07-24 17:08:26,652 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43483,1690218390174' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-24 17:08:26,652 INFO [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-24 17:08:26,652 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 17:08:26,652 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 17:08:26,652 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,652 INFO [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 17:08:26,657 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,658 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,658 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,658 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:26,658 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:26,657 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,658 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:26,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:08:26,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:08:26,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:26,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:26,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:26,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:26,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:08:26,659 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:08:26,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:26,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:26,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,660 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:26,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:08:26,660 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:26,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:08:26,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:26,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:26,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:08:26,663 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:08:26,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,663 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:26,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:08:26,664 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:26,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:26,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:26,667 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:26,667 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:26,667 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:26,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:26,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:26,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:26,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:26,668 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:26,668 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:26,668 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,669 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:26,669 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:26,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:26,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:26,670 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:26,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:26,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:26,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:26,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:26,671 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,671 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,671 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:08:26,671 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,671 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:26,671 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,671 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:26,671 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:08:26,671 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,671 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,671 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:08:26,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:26,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:26,674 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,701 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:08:26,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 17:08:26,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46651] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-24 17:08:26,703 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 17:08:26,770 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,825 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-24 17:08:26,825 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,826 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:26,826 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1690218506394Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690218506671 (+277 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690218506671Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690218506688 (+17 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690218506763 (+75 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1690218506825 (+62 ms) 2023-07-24 17:08:26,829 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 17:08:26,833 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 433 msec 2023-07-24 17:08:27,003 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:08:27,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 17:08:27,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46651] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 17:08:27,013 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37115] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1690218505686.1470aa8eedfe37b6836860ac245f3204. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 17:08:27,014 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43483] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1690218505686.4f6ce1604d7263e93b3764c8a3e39ed9. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 17:08:27,018 DEBUG [Listener at jenkins-hbase4.apache.org/34881] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,018 DEBUG [Listener at jenkins-hbase4.apache.org/34881] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1690218505686.1470aa8eedfe37b6836860ac245f3204. 2023-07-24 17:08:27,018 INFO [Listener at jenkins-hbase4.apache.org/34881] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 17:08:27,034 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46651] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 17:08:27,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46651] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690218507034 (current time:1690218507034). 2023-07-24 17:08:27,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46651] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 17:08:27,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46651] zookeeper.ReadOnlyZKClient(139): Connect 0x42a18b06 to 127.0.0.1:49884 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:08:27,052 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-24 17:08:27,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24e7d77d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:08:27,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46651] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:08:27,066 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49928, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:08:27,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x42a18b06 to 127.0.0.1:49884 2023-07-24 17:08:27,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:08:27,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46651] zookeeper.ReadOnlyZKClient(139): Connect 0x442e165c to 127.0.0.1:49884 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:08:27,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a994c64, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:08:27,174 DEBUG [hconnection-0x105f3e75-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:08:27,179 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49938, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:08:27,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x442e165c to 127.0.0.1:49884 2023-07-24 17:08:27,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:08:27,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46651] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-24 17:08:27,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46651] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 17:08:27,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46651] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 17:08:27,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 17:08:27,192 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 17:08:27,192 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1690219107192 2023-07-24 17:08:27,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46651] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 17:08:27,192 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,194 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 17:08:27,194 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 17:08:27,194 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 17:08:27,195 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 17:08:27,197 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-07-24 17:08:27,198 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 17:08:27,199 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1690219107199 2023-07-24 17:08:27,212 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,212 INFO [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-24 17:08:27,212 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:08:27,214 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-24 17:08:27,214 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-24 17:08:27,214 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,214 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,216 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:27,216 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:27,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:27,216 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:27,216 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:27,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:27,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:27,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:27,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:27,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:27,216 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:27,217 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:27,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,217 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,217 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,217 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-24 17:08:27,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-24 17:08:27,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-24 17:08:27,218 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 17:08:27,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,218 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 17:08:27,218 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 17:08:27,223 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,223 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 17:08:27,223 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:08:27,224 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 17:08:27,225 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 17:08:27,225 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,225 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37115,1690218390225' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 17:08:27,225 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 17:08:27,225 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:08:27,226 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,226 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:27,228 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 17:08:27,228 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:08:27,228 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:27,229 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 17:08:27,229 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:27,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:08:27,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:08:27,228 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 17:08:27,228 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 17:08:27,229 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 17:08:27,229 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43483,1690218390174' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 17:08:27,229 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 17:08:27,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:08:27,229 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44109,1690218390103' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 17:08:27,229 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,230 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:08:27,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:08:27,232 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:27,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,232 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,233 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,233 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,234 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:08:27,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:27,234 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,234 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:08:27,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:08:27,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:27,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:08:27,235 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37115,1690218390225' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-24 17:08:27,235 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4d841ec9[Count = 1] remaining members to acquire global barrier 2023-07-24 17:08:27,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:27,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:08:27,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:08:27,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:08:27,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:08:27,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:27,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:08:27,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:27,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:08:27,238 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43483,1690218390174' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-24 17:08:27,238 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4d841ec9[Count = 0] remaining members to acquire global barrier 2023-07-24 17:08:27,238 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-24 17:08:27,238 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,240 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,240 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,240 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,240 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:27,240 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 17:08:27,240 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 17:08:27,240 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 17:08:27,241 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:27,241 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 17:08:27,241 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 17:08:27,241 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690218505686.4f6ce1604d7263e93b3764c8a3e39ed9. 2023-07-24 17:08:27,241 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690218505686.4f6ce1604d7263e93b3764c8a3e39ed9. started... 2023-07-24 17:08:27,240 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 17:08:27,241 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690218505686.1470aa8eedfe37b6836860ac245f3204. 2023-07-24 17:08:27,241 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 17:08:27,241 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 17:08:27,241 INFO [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4f6ce1604d7263e93b3764c8a3e39ed9 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-24 17:08:27,241 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690218505686.1470aa8eedfe37b6836860ac245f3204. started... 2023-07-24 17:08:27,241 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 17:08:27,241 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,44109,1690218390103' in zk 2023-07-24 17:08:27,241 INFO [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 1470aa8eedfe37b6836860ac245f3204 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-24 17:08:27,243 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 17:08:27,243 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:08:27,243 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 17:08:27,257 INFO [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion/1470aa8eedfe37b6836860ac245f3204/.tmp/cf/2756d577d6b341bab4ab407f32d8f2b8 2023-07-24 17:08:27,262 INFO [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion/4f6ce1604d7263e93b3764c8a3e39ed9/.tmp/cf/c49438d964124264a94c5443e4e5957d 2023-07-24 17:08:27,264 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion/1470aa8eedfe37b6836860ac245f3204/.tmp/cf/2756d577d6b341bab4ab407f32d8f2b8 as hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion/1470aa8eedfe37b6836860ac245f3204/cf/2756d577d6b341bab4ab407f32d8f2b8 2023-07-24 17:08:27,269 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion/4f6ce1604d7263e93b3764c8a3e39ed9/.tmp/cf/c49438d964124264a94c5443e4e5957d as hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion/4f6ce1604d7263e93b3764c8a3e39ed9/cf/c49438d964124264a94c5443e4e5957d 2023-07-24 17:08:27,270 INFO [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion/1470aa8eedfe37b6836860ac245f3204/cf/2756d577d6b341bab4ab407f32d8f2b8, entries=3, sequenceid=6, filesize=5.0 K 2023-07-24 17:08:27,271 INFO [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 1470aa8eedfe37b6836860ac245f3204 in 30ms, sequenceid=6, compaction requested=false 2023-07-24 17:08:27,273 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1470aa8eedfe37b6836860ac245f3204: 2023-07-24 17:08:27,273 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1690218505686.1470aa8eedfe37b6836860ac245f3204.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,273 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 17:08:27,274 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion/1470aa8eedfe37b6836860ac245f3204/cf/2756d577d6b341bab4ab407f32d8f2b8] hfiles 2023-07-24 17:08:27,274 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion/1470aa8eedfe37b6836860ac245f3204/cf/2756d577d6b341bab4ab407f32d8f2b8 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,279 INFO [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion/4f6ce1604d7263e93b3764c8a3e39ed9/cf/c49438d964124264a94c5443e4e5957d, entries=47, sequenceid=6, filesize=8.0 K 2023-07-24 17:08:27,287 INFO [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 4f6ce1604d7263e93b3764c8a3e39ed9 in 46ms, sequenceid=6, compaction requested=false 2023-07-24 17:08:27,288 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4f6ce1604d7263e93b3764c8a3e39ed9: 2023-07-24 17:08:27,288 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1690218505686.4f6ce1604d7263e93b3764c8a3e39ed9.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,288 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 17:08:27,288 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion/4f6ce1604d7263e93b3764c8a3e39ed9/cf/c49438d964124264a94c5443e4e5957d] hfiles 2023-07-24 17:08:27,288 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion/4f6ce1604d7263e93b3764c8a3e39ed9/cf/c49438d964124264a94c5443e4e5957d for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,297 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:08:27,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 17:08:27,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46651] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-24 17:08:27,299 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 17:08:27,311 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690218505686.4f6ce1604d7263e93b3764c8a3e39ed9. completed. 2023-07-24 17:08:27,311 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690218505686.4f6ce1604d7263e93b3764c8a3e39ed9. 2023-07-24 17:08:27,311 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 17:08:27,311 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 17:08:27,311 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:27,311 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 17:08:27,311 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43483,1690218390174' in zk 2023-07-24 17:08:27,319 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 17:08:27,319 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:27,319 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:08:27,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:27,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:08:27,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:08:27,319 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 17:08:27,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:08:27,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:08:27,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:27,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:08:27,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:27,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:08:27,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:08:27,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:27,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,43483,1690218390174': 2023-07-24 17:08:27,328 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43483,1690218390174' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-24 17:08:27,499 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:08:27,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 17:08:27,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46651] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-24 17:08:27,500 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 17:08:27,700 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690218505686.1470aa8eedfe37b6836860ac245f3204. completed. 2023-07-24 17:08:27,700 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690218505686.1470aa8eedfe37b6836860ac245f3204. 2023-07-24 17:08:27,700 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 17:08:27,700 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 17:08:27,700 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:27,700 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 17:08:27,700 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37115,1690218390225' in zk 2023-07-24 17:08:27,703 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:27,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:27,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:08:27,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:08:27,703 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 17:08:27,703 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:08:27,703 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 17:08:27,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:08:27,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:08:27,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:27,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:08:27,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:27,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:08:27,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:08:27,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:27,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:27,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,37115,1690218390225': 2023-07-24 17:08:27,710 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37115,1690218390225' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-24 17:08:27,710 INFO [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-24 17:08:27,711 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 17:08:27,711 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 17:08:27,711 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,711 INFO [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 17:08:27,717 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,717 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,717 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,717 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:08:27,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:08:27,717 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:27,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,718 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:27,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:08:27,717 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:27,717 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:27,718 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:08:27,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:27,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:27,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:27,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:27,719 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:27,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:27,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:08:27,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:27,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:27,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:08:27,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:27,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:08:27,721 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:08:27,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,722 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:27,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:08:27,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:27,723 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:27,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:27,726 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:27,726 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:27,726 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:27,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:27,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:27,727 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:27,727 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:27,726 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,727 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:08:27,727 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:27,727 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,727 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:27,727 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,727 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:27,727 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:08:27,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:27,727 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:27,730 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:27,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:27,727 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:27,730 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:27,730 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:08:27,730 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,730 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,731 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:27,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:27,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:27,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:27,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:27,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:27,754 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,779 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-24 17:08:27,780 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,780 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:27,780 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1690218507193Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1690218507727 (+534 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1690218507727Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1690218507736 (+9 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1690218507746 (+10 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1690218507779 (+33 ms) 2023-07-24 17:08:27,783 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 17:08:27,784 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 589 msec 2023-07-24 17:08:27,801 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:08:27,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 17:08:27,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46651] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 17:08:27,842 DEBUG [Listener at jenkins-hbase4.apache.org/34881] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 17:08:27,851 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49950, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 17:08:27,853 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37115] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-24 17:08:27,854 DEBUG [Listener at jenkins-hbase4.apache.org/34881] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 17:08:27,866 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53076, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 17:08:27,871 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43483] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-24 17:08:27,871 DEBUG [Listener at jenkins-hbase4.apache.org/34881] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 17:08:27,882 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41018, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 17:08:27,883 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44109] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-24 17:08:27,885 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46651] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-24 17:08:27,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,893 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 17:08:27,894 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46651] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-24 17:08:27,895 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 17:08:27,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-24 17:08:27,911 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cba8d67f9148a30e72fa8da068613aaa 2023-07-24 17:08:27,913 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cba8d67f9148a30e72fa8da068613aaa empty. 2023-07-24 17:08:27,913 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cba8d67f9148a30e72fa8da068613aaa 2023-07-24 17:08:27,914 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/19d3d567a84b0a0c49e6da2f7539eec1 2023-07-24 17:08:27,916 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/19d3d567a84b0a0c49e6da2f7539eec1 empty. 2023-07-24 17:08:27,917 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/19d3d567a84b0a0c49e6da2f7539eec1 2023-07-24 17:08:27,918 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-24 17:08:27,969 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-24 17:08:27,983 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 19d3d567a84b0a0c49e6da2f7539eec1, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690218507885.19d3d567a84b0a0c49e6da2f7539eec1.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp 2023-07-24 17:08:27,990 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => cba8d67f9148a30e72fa8da068613aaa, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1690218507885.cba8d67f9148a30e72fa8da068613aaa.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp 2023-07-24 17:08:27,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-24 17:08:28,092 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1690218507885.cba8d67f9148a30e72fa8da068613aaa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:08:28,093 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing cba8d67f9148a30e72fa8da068613aaa, disabling compactions & flushes 2023-07-24 17:08:28,093 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690218507885.cba8d67f9148a30e72fa8da068613aaa. 2023-07-24 17:08:28,093 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690218507885.cba8d67f9148a30e72fa8da068613aaa. 2023-07-24 17:08:28,093 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690218507885.cba8d67f9148a30e72fa8da068613aaa. after waiting 0 ms 2023-07-24 17:08:28,093 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690218507885.cba8d67f9148a30e72fa8da068613aaa. 2023-07-24 17:08:28,093 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1690218507885.cba8d67f9148a30e72fa8da068613aaa. 2023-07-24 17:08:28,093 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for cba8d67f9148a30e72fa8da068613aaa: 2023-07-24 17:08:28,093 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690218507885.19d3d567a84b0a0c49e6da2f7539eec1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:08:28,094 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 19d3d567a84b0a0c49e6da2f7539eec1, disabling compactions & flushes 2023-07-24 17:08:28,094 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690218507885.19d3d567a84b0a0c49e6da2f7539eec1. 2023-07-24 17:08:28,094 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690218507885.19d3d567a84b0a0c49e6da2f7539eec1. 2023-07-24 17:08:28,094 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690218507885.19d3d567a84b0a0c49e6da2f7539eec1. after waiting 0 ms 2023-07-24 17:08:28,094 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690218507885.19d3d567a84b0a0c49e6da2f7539eec1. 2023-07-24 17:08:28,094 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690218507885.19d3d567a84b0a0c49e6da2f7539eec1. 2023-07-24 17:08:28,094 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 19d3d567a84b0a0c49e6da2f7539eec1: 2023-07-24 17:08:28,098 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 17:08:28,099 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690218507885.cba8d67f9148a30e72fa8da068613aaa.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690218508099"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218508099"}]},"ts":"1690218508099"} 2023-07-24 17:08:28,099 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690218507885.19d3d567a84b0a0c49e6da2f7539eec1.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690218508099"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218508099"}]},"ts":"1690218508099"} 2023-07-24 17:08:28,107 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 17:08:28,108 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 17:08:28,109 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218508109"}]},"ts":"1690218508109"} 2023-07-24 17:08:28,110 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-24 17:08:28,113 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 17:08:28,114 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 17:08:28,114 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 17:08:28,115 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 17:08:28,115 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 17:08:28,115 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=19d3d567a84b0a0c49e6da2f7539eec1, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=cba8d67f9148a30e72fa8da068613aaa, ASSIGN}] 2023-07-24 17:08:28,119 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=cba8d67f9148a30e72fa8da068613aaa, ASSIGN 2023-07-24 17:08:28,119 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=19d3d567a84b0a0c49e6da2f7539eec1, ASSIGN 2023-07-24 17:08:28,121 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=cba8d67f9148a30e72fa8da068613aaa, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37115,1690218390225; forceNewPlan=false, retain=false 2023-07-24 17:08:28,121 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=19d3d567a84b0a0c49e6da2f7539eec1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43483,1690218390174; forceNewPlan=false, retain=false 2023-07-24 17:08:28,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-24 17:08:28,271 INFO [jenkins-hbase4:46651] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 17:08:28,273 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=cba8d67f9148a30e72fa8da068613aaa, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:28,273 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=19d3d567a84b0a0c49e6da2f7539eec1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:28,274 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690218507885.19d3d567a84b0a0c49e6da2f7539eec1.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690218508273"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218508273"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218508273"}]},"ts":"1690218508273"} 2023-07-24 17:08:28,274 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690218507885.cba8d67f9148a30e72fa8da068613aaa.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690218508273"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218508273"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218508273"}]},"ts":"1690218508273"} 2023-07-24 17:08:28,275 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure cba8d67f9148a30e72fa8da068613aaa, server=jenkins-hbase4.apache.org,37115,1690218390225}] 2023-07-24 17:08:28,276 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure 19d3d567a84b0a0c49e6da2f7539eec1, server=jenkins-hbase4.apache.org,43483,1690218390174}] 2023-07-24 17:08:28,431 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1690218507885.cba8d67f9148a30e72fa8da068613aaa. 2023-07-24 17:08:28,431 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1690218507885.19d3d567a84b0a0c49e6da2f7539eec1. 2023-07-24 17:08:28,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cba8d67f9148a30e72fa8da068613aaa, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1690218507885.cba8d67f9148a30e72fa8da068613aaa.', STARTKEY => '2', ENDKEY => ''} 2023-07-24 17:08:28,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 19d3d567a84b0a0c49e6da2f7539eec1, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690218507885.19d3d567a84b0a0c49e6da2f7539eec1.', STARTKEY => '', ENDKEY => '2'} 2023-07-24 17:08:28,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1690218507885.cba8d67f9148a30e72fa8da068613aaa. service=AccessControlService 2023-07-24 17:08:28,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1690218507885.19d3d567a84b0a0c49e6da2f7539eec1. service=AccessControlService 2023-07-24 17:08:28,432 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 17:08:28,432 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 17:08:28,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 cba8d67f9148a30e72fa8da068613aaa 2023-07-24 17:08:28,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 19d3d567a84b0a0c49e6da2f7539eec1 2023-07-24 17:08:28,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1690218507885.cba8d67f9148a30e72fa8da068613aaa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:08:28,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cba8d67f9148a30e72fa8da068613aaa 2023-07-24 17:08:28,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cba8d67f9148a30e72fa8da068613aaa 2023-07-24 17:08:28,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690218507885.19d3d567a84b0a0c49e6da2f7539eec1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:08:28,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 19d3d567a84b0a0c49e6da2f7539eec1 2023-07-24 17:08:28,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 19d3d567a84b0a0c49e6da2f7539eec1 2023-07-24 17:08:28,439 INFO [StoreOpener-19d3d567a84b0a0c49e6da2f7539eec1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 19d3d567a84b0a0c49e6da2f7539eec1 2023-07-24 17:08:28,442 INFO [StoreOpener-cba8d67f9148a30e72fa8da068613aaa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region cba8d67f9148a30e72fa8da068613aaa 2023-07-24 17:08:28,443 DEBUG [StoreOpener-19d3d567a84b0a0c49e6da2f7539eec1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/19d3d567a84b0a0c49e6da2f7539eec1/cf 2023-07-24 17:08:28,443 DEBUG [StoreOpener-19d3d567a84b0a0c49e6da2f7539eec1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/19d3d567a84b0a0c49e6da2f7539eec1/cf 2023-07-24 17:08:28,443 DEBUG [StoreOpener-cba8d67f9148a30e72fa8da068613aaa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cba8d67f9148a30e72fa8da068613aaa/cf 2023-07-24 17:08:28,443 DEBUG [StoreOpener-cba8d67f9148a30e72fa8da068613aaa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cba8d67f9148a30e72fa8da068613aaa/cf 2023-07-24 17:08:28,443 INFO [StoreOpener-19d3d567a84b0a0c49e6da2f7539eec1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 19d3d567a84b0a0c49e6da2f7539eec1 columnFamilyName cf 2023-07-24 17:08:28,444 INFO [StoreOpener-cba8d67f9148a30e72fa8da068613aaa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cba8d67f9148a30e72fa8da068613aaa columnFamilyName cf 2023-07-24 17:08:28,444 INFO [StoreOpener-19d3d567a84b0a0c49e6da2f7539eec1-1] regionserver.HStore(310): Store=19d3d567a84b0a0c49e6da2f7539eec1/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 17:08:28,444 INFO [StoreOpener-cba8d67f9148a30e72fa8da068613aaa-1] regionserver.HStore(310): Store=cba8d67f9148a30e72fa8da068613aaa/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 17:08:28,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/19d3d567a84b0a0c49e6da2f7539eec1 2023-07-24 17:08:28,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cba8d67f9148a30e72fa8da068613aaa 2023-07-24 17:08:28,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/19d3d567a84b0a0c49e6da2f7539eec1 2023-07-24 17:08:28,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cba8d67f9148a30e72fa8da068613aaa 2023-07-24 17:08:28,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 19d3d567a84b0a0c49e6da2f7539eec1 2023-07-24 17:08:28,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cba8d67f9148a30e72fa8da068613aaa 2023-07-24 17:08:28,450 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/19d3d567a84b0a0c49e6da2f7539eec1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 17:08:28,450 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cba8d67f9148a30e72fa8da068613aaa/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 17:08:28,451 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 19d3d567a84b0a0c49e6da2f7539eec1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64700845, jitterRate=-0.03588227927684784}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 17:08:28,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 19d3d567a84b0a0c49e6da2f7539eec1: 2023-07-24 17:08:28,451 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cba8d67f9148a30e72fa8da068613aaa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67810708, jitterRate=0.010458290576934814}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 17:08:28,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cba8d67f9148a30e72fa8da068613aaa: 2023-07-24 17:08:28,452 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1690218507885.cba8d67f9148a30e72fa8da068613aaa., pid=69, masterSystemTime=1690218508427 2023-07-24 17:08:28,452 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1690218507885.19d3d567a84b0a0c49e6da2f7539eec1., pid=70, masterSystemTime=1690218508427 2023-07-24 17:08:28,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1690218507885.cba8d67f9148a30e72fa8da068613aaa. 2023-07-24 17:08:28,455 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1690218507885.cba8d67f9148a30e72fa8da068613aaa. 2023-07-24 17:08:28,455 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=cba8d67f9148a30e72fa8da068613aaa, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:28,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1690218507885.19d3d567a84b0a0c49e6da2f7539eec1. 2023-07-24 17:08:28,455 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1690218507885.19d3d567a84b0a0c49e6da2f7539eec1. 2023-07-24 17:08:28,455 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690218507885.cba8d67f9148a30e72fa8da068613aaa.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690218508455"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690218508455"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690218508455"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690218508455"}]},"ts":"1690218508455"} 2023-07-24 17:08:28,456 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=19d3d567a84b0a0c49e6da2f7539eec1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:28,456 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690218507885.19d3d567a84b0a0c49e6da2f7539eec1.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690218508456"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690218508456"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690218508456"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690218508456"}]},"ts":"1690218508456"} 2023-07-24 17:08:28,459 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=68 2023-07-24 17:08:28,459 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure cba8d67f9148a30e72fa8da068613aaa, server=jenkins-hbase4.apache.org,37115,1690218390225 in 182 msec 2023-07-24 17:08:28,460 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=67 2023-07-24 17:08:28,460 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure 19d3d567a84b0a0c49e6da2f7539eec1, server=jenkins-hbase4.apache.org,43483,1690218390174 in 182 msec 2023-07-24 17:08:28,460 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=cba8d67f9148a30e72fa8da068613aaa, ASSIGN in 344 msec 2023-07-24 17:08:28,462 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-24 17:08:28,462 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=19d3d567a84b0a0c49e6da2f7539eec1, ASSIGN in 345 msec 2023-07-24 17:08:28,462 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 17:08:28,463 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218508462"}]},"ts":"1690218508462"} 2023-07-24 17:08:28,464 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-24 17:08:28,466 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 17:08:28,467 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-24 17:08:28,468 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37115] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-24 17:08:28,471 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:08:28,471 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:08:28,471 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:08:28,471 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:08:28,472 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 17:08:28,473 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 17:08:28,473 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-24 17:08:28,473 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-24 17:08:28,473 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 17:08:28,473 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 17:08:28,473 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-24 17:08:28,473 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-24 17:08:28,474 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 587 msec 2023-07-24 17:08:28,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-24 17:08:28,501 INFO [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-24 17:08:28,526 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 19d3d567a84b0a0c49e6da2f7539eec1, cba8d67f9148a30e72fa8da068613aaa 2023-07-24 17:08:28,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[19d3d567a84b0a0c49e6da2f7539eec1, cba8d67f9148a30e72fa8da068613aaa], force=true 2023-07-24 17:08:28,541 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[19d3d567a84b0a0c49e6da2f7539eec1, cba8d67f9148a30e72fa8da068613aaa], force=true 2023-07-24 17:08:28,541 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[19d3d567a84b0a0c49e6da2f7539eec1, cba8d67f9148a30e72fa8da068613aaa], force=true 2023-07-24 17:08:28,541 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[19d3d567a84b0a0c49e6da2f7539eec1, cba8d67f9148a30e72fa8da068613aaa], force=true 2023-07-24 17:08:28,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 17:08:28,594 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=19d3d567a84b0a0c49e6da2f7539eec1, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=cba8d67f9148a30e72fa8da068613aaa, UNASSIGN}] 2023-07-24 17:08:28,596 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=19d3d567a84b0a0c49e6da2f7539eec1, UNASSIGN 2023-07-24 17:08:28,597 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=cba8d67f9148a30e72fa8da068613aaa, UNASSIGN 2023-07-24 17:08:28,598 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=19d3d567a84b0a0c49e6da2f7539eec1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:28,598 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690218507885.19d3d567a84b0a0c49e6da2f7539eec1.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690218508598"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218508598"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218508598"}]},"ts":"1690218508598"} 2023-07-24 17:08:28,598 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=cba8d67f9148a30e72fa8da068613aaa, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:28,599 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690218507885.cba8d67f9148a30e72fa8da068613aaa.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690218508598"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218508598"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218508598"}]},"ts":"1690218508598"} 2023-07-24 17:08:28,602 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 19d3d567a84b0a0c49e6da2f7539eec1, server=jenkins-hbase4.apache.org,43483,1690218390174}] 2023-07-24 17:08:28,607 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure cba8d67f9148a30e72fa8da068613aaa, server=jenkins-hbase4.apache.org,37115,1690218390225}] 2023-07-24 17:08:28,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 17:08:28,757 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 19d3d567a84b0a0c49e6da2f7539eec1 2023-07-24 17:08:28,760 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 19d3d567a84b0a0c49e6da2f7539eec1, disabling compactions & flushes 2023-07-24 17:08:28,760 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690218507885.19d3d567a84b0a0c49e6da2f7539eec1. 2023-07-24 17:08:28,760 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690218507885.19d3d567a84b0a0c49e6da2f7539eec1. 2023-07-24 17:08:28,760 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690218507885.19d3d567a84b0a0c49e6da2f7539eec1. after waiting 0 ms 2023-07-24 17:08:28,760 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690218507885.19d3d567a84b0a0c49e6da2f7539eec1. 2023-07-24 17:08:28,760 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 19d3d567a84b0a0c49e6da2f7539eec1 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-24 17:08:28,762 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close cba8d67f9148a30e72fa8da068613aaa 2023-07-24 17:08:28,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cba8d67f9148a30e72fa8da068613aaa, disabling compactions & flushes 2023-07-24 17:08:28,764 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690218507885.cba8d67f9148a30e72fa8da068613aaa. 2023-07-24 17:08:28,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690218507885.cba8d67f9148a30e72fa8da068613aaa. 2023-07-24 17:08:28,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690218507885.cba8d67f9148a30e72fa8da068613aaa. after waiting 0 ms 2023-07-24 17:08:28,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690218507885.cba8d67f9148a30e72fa8da068613aaa. 2023-07-24 17:08:28,764 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing cba8d67f9148a30e72fa8da068613aaa 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-24 17:08:28,793 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cba8d67f9148a30e72fa8da068613aaa/.tmp/cf/a7d372066936468d96c24a1a2b8894fb 2023-07-24 17:08:28,799 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cba8d67f9148a30e72fa8da068613aaa/.tmp/cf/a7d372066936468d96c24a1a2b8894fb as hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cba8d67f9148a30e72fa8da068613aaa/cf/a7d372066936468d96c24a1a2b8894fb 2023-07-24 17:08:28,805 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cba8d67f9148a30e72fa8da068613aaa/cf/a7d372066936468d96c24a1a2b8894fb, entries=1, sequenceid=5, filesize=4.7 K 2023-07-24 17:08:28,806 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for cba8d67f9148a30e72fa8da068613aaa in 42ms, sequenceid=5, compaction requested=false 2023-07-24 17:08:28,806 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-24 17:08:28,830 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cba8d67f9148a30e72fa8da068613aaa/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-24 17:08:28,830 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 17:08:28,830 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1690218507885.cba8d67f9148a30e72fa8da068613aaa. 2023-07-24 17:08:28,830 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cba8d67f9148a30e72fa8da068613aaa: 2023-07-24 17:08:28,833 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed cba8d67f9148a30e72fa8da068613aaa 2023-07-24 17:08:28,834 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=cba8d67f9148a30e72fa8da068613aaa, regionState=CLOSED 2023-07-24 17:08:28,834 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690218507885.cba8d67f9148a30e72fa8da068613aaa.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690218508834"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218508834"}]},"ts":"1690218508834"} 2023-07-24 17:08:28,842 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-24 17:08:28,843 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure cba8d67f9148a30e72fa8da068613aaa, server=jenkins-hbase4.apache.org,37115,1690218390225 in 232 msec 2023-07-24 17:08:28,845 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=cba8d67f9148a30e72fa8da068613aaa, UNASSIGN in 249 msec 2023-07-24 17:08:28,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 17:08:29,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 17:08:29,177 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/19d3d567a84b0a0c49e6da2f7539eec1/.tmp/cf/a6546e00d38d4b24a71fb50d4f948b67 2023-07-24 17:08:29,185 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/19d3d567a84b0a0c49e6da2f7539eec1/.tmp/cf/a6546e00d38d4b24a71fb50d4f948b67 as hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/19d3d567a84b0a0c49e6da2f7539eec1/cf/a6546e00d38d4b24a71fb50d4f948b67 2023-07-24 17:08:29,192 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/19d3d567a84b0a0c49e6da2f7539eec1/cf/a6546e00d38d4b24a71fb50d4f948b67, entries=1, sequenceid=5, filesize=4.7 K 2023-07-24 17:08:29,193 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 19d3d567a84b0a0c49e6da2f7539eec1 in 433ms, sequenceid=5, compaction requested=false 2023-07-24 17:08:29,214 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/19d3d567a84b0a0c49e6da2f7539eec1/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-24 17:08:29,215 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 17:08:29,215 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690218507885.19d3d567a84b0a0c49e6da2f7539eec1. 2023-07-24 17:08:29,215 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 19d3d567a84b0a0c49e6da2f7539eec1: 2023-07-24 17:08:29,218 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 19d3d567a84b0a0c49e6da2f7539eec1 2023-07-24 17:08:29,220 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=19d3d567a84b0a0c49e6da2f7539eec1, regionState=CLOSED 2023-07-24 17:08:29,220 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690218507885.19d3d567a84b0a0c49e6da2f7539eec1.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690218509220"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218509220"}]},"ts":"1690218509220"} 2023-07-24 17:08:29,230 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-24 17:08:29,230 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 19d3d567a84b0a0c49e6da2f7539eec1, server=jenkins-hbase4.apache.org,43483,1690218390174 in 620 msec 2023-07-24 17:08:29,232 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-24 17:08:29,233 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=19d3d567a84b0a0c49e6da2f7539eec1, UNASSIGN in 641 msec 2023-07-24 17:08:29,329 DEBUG [PEWorker-5] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39dabea49ee2307817bddb683bf879ee/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-24 17:08:29,332 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690218507885.19d3d567a84b0a0c49e6da2f7539eec1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-24 17:08:29,332 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690218507885.cba8d67f9148a30e72fa8da068613aaa.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-24 17:08:29,332 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690218507886.39dabea49ee2307817bddb683bf879ee.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-24 17:08:29,389 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=39dabea49ee2307817bddb683bf879ee, ASSIGN}] 2023-07-24 17:08:29,391 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=39dabea49ee2307817bddb683bf879ee, ASSIGN 2023-07-24 17:08:29,392 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=39dabea49ee2307817bddb683bf879ee, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,43483,1690218390174; forceNewPlan=false, retain=false 2023-07-24 17:08:29,542 INFO [jenkins-hbase4:46651] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-24 17:08:29,544 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=39dabea49ee2307817bddb683bf879ee, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:29,545 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690218507886.39dabea49ee2307817bddb683bf879ee.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690218509544"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218509544"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218509544"}]},"ts":"1690218509544"} 2023-07-24 17:08:29,546 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 39dabea49ee2307817bddb683bf879ee, server=jenkins-hbase4.apache.org,43483,1690218390174}] 2023-07-24 17:08:29,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 17:08:29,702 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1690218507886.39dabea49ee2307817bddb683bf879ee. 2023-07-24 17:08:29,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 39dabea49ee2307817bddb683bf879ee, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690218507886.39dabea49ee2307817bddb683bf879ee.', STARTKEY => '', ENDKEY => ''} 2023-07-24 17:08:29,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1690218507886.39dabea49ee2307817bddb683bf879ee. service=AccessControlService 2023-07-24 17:08:29,702 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 17:08:29,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 39dabea49ee2307817bddb683bf879ee 2023-07-24 17:08:29,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690218507886.39dabea49ee2307817bddb683bf879ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:08:29,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 39dabea49ee2307817bddb683bf879ee 2023-07-24 17:08:29,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 39dabea49ee2307817bddb683bf879ee 2023-07-24 17:08:29,704 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39dabea49ee2307817bddb683bf879ee/.regioninfo 2023-07-24 17:08:29,716 INFO [StoreOpener-39dabea49ee2307817bddb683bf879ee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 39dabea49ee2307817bddb683bf879ee 2023-07-24 17:08:29,717 DEBUG [StoreOpener-39dabea49ee2307817bddb683bf879ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39dabea49ee2307817bddb683bf879ee/cf 2023-07-24 17:08:29,717 DEBUG [StoreOpener-39dabea49ee2307817bddb683bf879ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39dabea49ee2307817bddb683bf879ee/cf 2023-07-24 17:08:29,718 INFO [StoreOpener-39dabea49ee2307817bddb683bf879ee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 39dabea49ee2307817bddb683bf879ee columnFamilyName cf 2023-07-24 17:08:29,750 DEBUG [StoreOpener-39dabea49ee2307817bddb683bf879ee-1] regionserver.HStore(539): loaded hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39dabea49ee2307817bddb683bf879ee/cf/a6546e00d38d4b24a71fb50d4f948b67.19d3d567a84b0a0c49e6da2f7539eec1->hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/19d3d567a84b0a0c49e6da2f7539eec1/cf/a6546e00d38d4b24a71fb50d4f948b67-top 2023-07-24 17:08:29,757 DEBUG [StoreOpener-39dabea49ee2307817bddb683bf879ee-1] regionserver.HStore(539): loaded hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39dabea49ee2307817bddb683bf879ee/cf/a7d372066936468d96c24a1a2b8894fb.cba8d67f9148a30e72fa8da068613aaa->hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cba8d67f9148a30e72fa8da068613aaa/cf/a7d372066936468d96c24a1a2b8894fb-top 2023-07-24 17:08:29,758 INFO [StoreOpener-39dabea49ee2307817bddb683bf879ee-1] regionserver.HStore(310): Store=39dabea49ee2307817bddb683bf879ee/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 17:08:29,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39dabea49ee2307817bddb683bf879ee 2023-07-24 17:08:29,760 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39dabea49ee2307817bddb683bf879ee 2023-07-24 17:08:29,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 39dabea49ee2307817bddb683bf879ee 2023-07-24 17:08:29,765 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 39dabea49ee2307817bddb683bf879ee; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61921218, jitterRate=-0.07730194926261902}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 17:08:29,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 39dabea49ee2307817bddb683bf879ee: 2023-07-24 17:08:29,766 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1690218507886.39dabea49ee2307817bddb683bf879ee., pid=77, masterSystemTime=1690218509698 2023-07-24 17:08:29,767 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1690218507886.39dabea49ee2307817bddb683bf879ee.,because compaction is disabled. 2023-07-24 17:08:29,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1690218507886.39dabea49ee2307817bddb683bf879ee. 2023-07-24 17:08:29,768 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1690218507886.39dabea49ee2307817bddb683bf879ee. 2023-07-24 17:08:29,769 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=39dabea49ee2307817bddb683bf879ee, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:29,769 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690218507886.39dabea49ee2307817bddb683bf879ee.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690218509769"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690218509769"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690218509769"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690218509769"}]},"ts":"1690218509769"} 2023-07-24 17:08:29,777 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-24 17:08:29,777 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 39dabea49ee2307817bddb683bf879ee, server=jenkins-hbase4.apache.org,43483,1690218390174 in 228 msec 2023-07-24 17:08:29,779 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-24 17:08:29,779 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=39dabea49ee2307817bddb683bf879ee, ASSIGN in 388 msec 2023-07-24 17:08:29,780 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[19d3d567a84b0a0c49e6da2f7539eec1, cba8d67f9148a30e72fa8da068613aaa], force=true in 1.2480 sec 2023-07-24 17:08:29,921 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397910_0004_000001 (auth:SIMPLE) 2023-07-24 17:08:30,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 17:08:30,656 INFO [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-24 17:08:30,657 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-24 17:08:30,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690218510657 (current time:1690218510657). 2023-07-24 17:08:30,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 17:08:30,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(139): Connect 0x7b74b4b8 to 127.0.0.1:49884 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:08:30,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@21a894d4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:08:30,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:08:30,674 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48566, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:08:30,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7b74b4b8 to 127.0.0.1:49884 2023-07-24 17:08:30,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:08:30,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(139): Connect 0x7f3142a1 to 127.0.0.1:49884 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:08:30,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@21bef88b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:08:30,695 DEBUG [hconnection-0x44d5d65c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:08:30,696 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48568, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:08:30,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7f3142a1 to 127.0.0.1:49884 2023-07-24 17:08:30,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:08:30,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-24 17:08:30,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 17:08:30,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-24 17:08:30,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-24 17:08:30,711 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-24 17:08:30,712 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1690219110712 2023-07-24 17:08:30,712 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-24 17:08:30,720 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 17:08:30,720 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 17:08:30,724 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-24 17:08:30,725 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-24 17:08:30,727 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 17 msec 2023-07-24 17:08:30,730 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-24 17:08:30,731 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1690219110731 2023-07-24 17:08:30,760 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,760 INFO [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-24 17:08:30,761 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:08:30,766 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-24 17:08:30,766 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-24 17:08:30,767 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,767 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,768 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:30,768 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:30,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:30,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:30,768 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:30,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:30,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:30,769 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:30,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:30,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:30,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,770 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:30,770 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 17:08:30,770 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,770 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,770 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-24 17:08:30,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,771 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-24 17:08:30,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-24 17:08:30,771 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,772 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-24 17:08:30,772 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:08:30,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-24 17:08:30,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,774 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-24 17:08:30,774 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-24 17:08:30,774 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-24 17:08:30,774 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37115,1690218390225' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-24 17:08:30,776 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,776 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,777 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-24 17:08:30,777 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:08:30,778 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-24 17:08:30,778 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-24 17:08:30,779 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-24 17:08:30,779 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43483,1690218390174' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-24 17:08:30,785 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:30,785 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:30,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:08:30,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:08:30,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:08:30,786 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,786 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:08:30,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:08:30,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:30,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:30,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:08:30,789 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43483,1690218390174' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-24 17:08:30,789 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@773b9802[Count = 0] remaining members to acquire global barrier 2023-07-24 17:08:30,789 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-24 17:08:30,790 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,792 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,792 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-24 17:08:30,798 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,798 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-24 17:08:30,798 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:08:30,799 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:30,799 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 17:08:30,820 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:08:30,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-24 17:08:30,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-24 17:08:30,821 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 17:08:30,829 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-24 17:08:30,830 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-24 17:08:30,830 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44109,1690218390103' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-24 17:08:30,832 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,834 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] zookeeper.ZKUtil(162): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,834 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 17:08:30,834 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 17:08:30,834 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,834 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1690218507886.39dabea49ee2307817bddb683bf879ee. 2023-07-24 17:08:30,834 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1690218507886.39dabea49ee2307817bddb683bf879ee. started... 2023-07-24 17:08:30,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,834 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,843 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:08:30,843 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-24 17:08:30,843 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-24 17:08:30,843 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,44109,1690218390103' in zk 2023-07-24 17:08:30,837 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 39dabea49ee2307817bddb683bf879ee: 2023-07-24 17:08:30,834 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,843 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:08:30,843 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-24 17:08:30,843 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-24 17:08:30,843 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,37115,1690218390225' in zk 2023-07-24 17:08:30,844 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690218507886.39dabea49ee2307817bddb683bf879ee.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,850 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-24 17:08:30,856 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:08:30,856 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-24 17:08:30,856 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 17:08:30,845 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-24 17:08:30,859 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:08:30,859 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-24 17:08:30,865 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39dabea49ee2307817bddb683bf879ee/cf/a6546e00d38d4b24a71fb50d4f948b67.19d3d567a84b0a0c49e6da2f7539eec1->hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/19d3d567a84b0a0c49e6da2f7539eec1/cf/a6546e00d38d4b24a71fb50d4f948b67-top, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39dabea49ee2307817bddb683bf879ee/cf/a7d372066936468d96c24a1a2b8894fb.cba8d67f9148a30e72fa8da068613aaa->hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cba8d67f9148a30e72fa8da068613aaa/cf/a7d372066936468d96c24a1a2b8894fb-top] hfiles 2023-07-24 17:08:30,865 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39dabea49ee2307817bddb683bf879ee/cf/a6546e00d38d4b24a71fb50d4f948b67.19d3d567a84b0a0c49e6da2f7539eec1 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,867 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39dabea49ee2307817bddb683bf879ee/cf/a7d372066936468d96c24a1a2b8894fb.cba8d67f9148a30e72fa8da068613aaa for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,918 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1690218507886.39dabea49ee2307817bddb683bf879ee. completed. 2023-07-24 17:08:30,918 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1690218507886.39dabea49ee2307817bddb683bf879ee. 2023-07-24 17:08:30,918 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 17:08:30,918 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 17:08:30,918 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:30,918 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-24 17:08:30,918 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,43483,1690218390174' in zk 2023-07-24 17:08:30,926 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:30,926 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-24 17:08:30,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:30,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:08:30,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:08:30,927 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:08:30,927 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-24 17:08:30,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:08:30,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:08:30,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:30,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:08:30,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:30,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:08:30,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:08:30,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:30,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:30,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,43483,1690218390174': 2023-07-24 17:08:30,938 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43483,1690218390174' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-24 17:08:30,938 INFO [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-24 17:08:30,938 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 17:08:30,939 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 17:08:30,939 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,939 INFO [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 17:08:30,942 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,942 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,942 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,942 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:30,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,942 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:30,942 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:30,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,943 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:08:30,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:08:30,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:30,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:30,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:30,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:30,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:30,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:30,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:08:30,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,945 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:30,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,947 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:08:30,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:08:30,950 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:30,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:30,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:08:30,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:30,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:08:30,953 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:08:30,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,954 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:30,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:08:30,954 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:30,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:30,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:30,959 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:30,959 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:30,959 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:30,959 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:30,959 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:30,959 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:08:30,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:30,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:30,959 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:30,960 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:30,960 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:30,960 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,959 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:08:30,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:30,959 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,960 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:30,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:30,960 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:30,960 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,960 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:30,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:30,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:30,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:30,960 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:30,961 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:30,961 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:08:30,961 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,961 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:30,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:30,961 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:30,994 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:31,014 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 17:08:31,022 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:08:31,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-24 17:08:31,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-24 17:08:31,023 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 17:08:31,324 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:08:31,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-24 17:08:31,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-24 17:08:31,325 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-24 17:08:31,529 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-24 17:08:31,529 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:31,529 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:31,529 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1690218510712Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690218510960 (+248 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690218510960Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690218510970 (+10 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690218510984 (+14 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1690218511529 (+545 ms) 2023-07-24 17:08:31,532 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-24 17:08:31,533 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 814 msec 2023-07-24 17:08:31,825 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:08:31,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-24 17:08:31,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 17:08:31,827 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/export-test/export-1690218511827 2023-07-24 17:08:31,827 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:41733, tgtDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/export-test/export-1690218511827, rawTgtDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/export-test/export-1690218511827, srcFsUri=hdfs://localhost:41733, srcDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d 2023-07-24 17:08:31,859 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:41733, inputRoot=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d 2023-07-24 17:08:31,859 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1079366663_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/export-test/export-1690218511827, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/export-test/export-1690218511827/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:31,859 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:41733, inputRoot=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d, snapshotDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-24 17:08:31,871 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/export-test/export-1690218511827/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:31,893 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:31,893 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:31,894 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:31,894 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:31,894 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:31,895 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:31,895 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:31,974 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/hadoop-3939391236889588863.jar 2023-07-24 17:08:31,974 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:31,975 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:31,975 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:31,976 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:31,976 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:31,977 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:31,977 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 17:08:31,977 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 17:08:31,978 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 17:08:31,978 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 17:08:31,979 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 17:08:31,979 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 17:08:31,979 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 17:08:31,980 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 17:08:31,980 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 17:08:31,980 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 17:08:31,981 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 17:08:31,981 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 17:08:31,982 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 17:08:31,982 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 17:08:31,983 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 17:08:31,983 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 17:08:31,984 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 17:08:32,590 WARN [Listener at jenkins-hbase4.apache.org/34881] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 17:08:32,593 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-24 17:08:32,595 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-24 17:08:32,714 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 17:08:32,715 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 17:08:32,926 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397910_0005_000001 (auth:SIMPLE) 2023-07-24 17:08:37,951 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397910_0005_000001 (auth:SIMPLE) 2023-07-24 17:08:40,357 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397910_0005_000001 (auth:SIMPLE) 2023-07-24 17:08:44,829 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397910_0005_000001 (auth:SIMPLE) 2023-07-24 17:08:46,874 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 17:08:46,892 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 17:08:46,930 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:46,931 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 17:08:46,931 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 17:08:46,931 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-789691247_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:46,932 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(367): hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-24 17:08:46,932 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(367): hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-24 17:08:46,932 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-789691247_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/export-test/export-1690218511827/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/export-test/export-1690218511827/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:46,933 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(367): hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/export-test/export-1690218511827/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-24 17:08:46,933 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(367): hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/export-test/export-1690218511827/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-24 17:08:46,942 INFO [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:46,943 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:46,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:46,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-24 17:08:46,950 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218526950"}]},"ts":"1690218526950"} 2023-07-24 17:08:46,951 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-24 17:08:46,953 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-24 17:08:46,955 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=39dabea49ee2307817bddb683bf879ee, UNASSIGN}] 2023-07-24 17:08:46,960 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=39dabea49ee2307817bddb683bf879ee, UNASSIGN 2023-07-24 17:08:46,961 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=39dabea49ee2307817bddb683bf879ee, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:46,962 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690218507886.39dabea49ee2307817bddb683bf879ee.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690218526961"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218526961"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218526961"}]},"ts":"1690218526961"} 2023-07-24 17:08:46,971 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 39dabea49ee2307817bddb683bf879ee, server=jenkins-hbase4.apache.org,43483,1690218390174}] 2023-07-24 17:08:47,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-24 17:08:47,124 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 39dabea49ee2307817bddb683bf879ee 2023-07-24 17:08:47,124 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 39dabea49ee2307817bddb683bf879ee, disabling compactions & flushes 2023-07-24 17:08:47,124 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690218507886.39dabea49ee2307817bddb683bf879ee. 2023-07-24 17:08:47,124 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690218507886.39dabea49ee2307817bddb683bf879ee. 2023-07-24 17:08:47,124 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690218507886.39dabea49ee2307817bddb683bf879ee. after waiting 0 ms 2023-07-24 17:08:47,124 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690218507886.39dabea49ee2307817bddb683bf879ee. 2023-07-24 17:08:47,155 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39dabea49ee2307817bddb683bf879ee/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-24 17:08:47,156 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 17:08:47,158 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690218507886.39dabea49ee2307817bddb683bf879ee. 2023-07-24 17:08:47,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 39dabea49ee2307817bddb683bf879ee: 2023-07-24 17:08:47,164 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 39dabea49ee2307817bddb683bf879ee 2023-07-24 17:08:47,165 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=39dabea49ee2307817bddb683bf879ee, regionState=CLOSED 2023-07-24 17:08:47,165 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690218507886.39dabea49ee2307817bddb683bf879ee.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690218527165"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218527165"}]},"ts":"1690218527165"} 2023-07-24 17:08:47,170 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-24 17:08:47,170 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 39dabea49ee2307817bddb683bf879ee, server=jenkins-hbase4.apache.org,43483,1690218390174 in 196 msec 2023-07-24 17:08:47,172 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-24 17:08:47,172 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=39dabea49ee2307817bddb683bf879ee, UNASSIGN in 215 msec 2023-07-24 17:08:47,173 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218527172"}]},"ts":"1690218527172"} 2023-07-24 17:08:47,174 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-24 17:08:47,176 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-24 17:08:47,178 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 234 msec 2023-07-24 17:08:47,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-24 17:08:47,253 INFO [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-24 17:08:47,253 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:47,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:47,257 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:47,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:47,258 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:47,260 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37115] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:47,264 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:47,264 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:47,264 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:47,264 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:47,266 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-24 17:08:47,266 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-24 17:08:47,267 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-24 17:08:47,267 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-24 17:08:47,268 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:47,268 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:47,268 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:47,268 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:08:47,268 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:47,268 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:08:47,268 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:08:47,268 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:08:47,269 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 17:08:47,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-24 17:08:47,269 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 17:08:47,269 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 17:08:47,269 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 17:08:47,278 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39dabea49ee2307817bddb683bf879ee 2023-07-24 17:08:47,279 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cba8d67f9148a30e72fa8da068613aaa 2023-07-24 17:08:47,279 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/19d3d567a84b0a0c49e6da2f7539eec1 2023-07-24 17:08:47,281 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39dabea49ee2307817bddb683bf879ee/cf, FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39dabea49ee2307817bddb683bf879ee/recovered.edits] 2023-07-24 17:08:47,287 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cba8d67f9148a30e72fa8da068613aaa/cf, FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cba8d67f9148a30e72fa8da068613aaa/recovered.edits] 2023-07-24 17:08:47,296 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/19d3d567a84b0a0c49e6da2f7539eec1/cf, FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/19d3d567a84b0a0c49e6da2f7539eec1/recovered.edits] 2023-07-24 17:08:47,303 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cba8d67f9148a30e72fa8da068613aaa/cf/a7d372066936468d96c24a1a2b8894fb to hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cba8d67f9148a30e72fa8da068613aaa/cf/a7d372066936468d96c24a1a2b8894fb 2023-07-24 17:08:47,305 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39dabea49ee2307817bddb683bf879ee/cf/a6546e00d38d4b24a71fb50d4f948b67.19d3d567a84b0a0c49e6da2f7539eec1 to hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39dabea49ee2307817bddb683bf879ee/cf/a6546e00d38d4b24a71fb50d4f948b67.19d3d567a84b0a0c49e6da2f7539eec1 2023-07-24 17:08:47,306 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/19d3d567a84b0a0c49e6da2f7539eec1/cf/a6546e00d38d4b24a71fb50d4f948b67 to hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/19d3d567a84b0a0c49e6da2f7539eec1/cf/a6546e00d38d4b24a71fb50d4f948b67 2023-07-24 17:08:47,309 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cba8d67f9148a30e72fa8da068613aaa/recovered.edits/8.seqid to hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cba8d67f9148a30e72fa8da068613aaa/recovered.edits/8.seqid 2023-07-24 17:08:47,310 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39dabea49ee2307817bddb683bf879ee/cf/a7d372066936468d96c24a1a2b8894fb.cba8d67f9148a30e72fa8da068613aaa to hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39dabea49ee2307817bddb683bf879ee/cf/a7d372066936468d96c24a1a2b8894fb.cba8d67f9148a30e72fa8da068613aaa 2023-07-24 17:08:47,310 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cba8d67f9148a30e72fa8da068613aaa 2023-07-24 17:08:47,312 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/19d3d567a84b0a0c49e6da2f7539eec1/recovered.edits/8.seqid to hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/19d3d567a84b0a0c49e6da2f7539eec1/recovered.edits/8.seqid 2023-07-24 17:08:47,312 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/19d3d567a84b0a0c49e6da2f7539eec1 2023-07-24 17:08:47,315 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39dabea49ee2307817bddb683bf879ee/recovered.edits/12.seqid to hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39dabea49ee2307817bddb683bf879ee/recovered.edits/12.seqid 2023-07-24 17:08:47,316 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39dabea49ee2307817bddb683bf879ee 2023-07-24 17:08:47,317 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-24 17:08:47,322 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:47,325 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-24 17:08:47,327 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-24 17:08:47,328 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:47,328 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-24 17:08:47,328 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690218507886.39dabea49ee2307817bddb683bf879ee.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690218527328"}]},"ts":"9223372036854775807"} 2023-07-24 17:08:47,332 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-24 17:08:47,332 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 39dabea49ee2307817bddb683bf879ee, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690218507886.39dabea49ee2307817bddb683bf879ee.', STARTKEY => '', ENDKEY => ''}] 2023-07-24 17:08:47,332 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-24 17:08:47,333 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690218527332"}]},"ts":"9223372036854775807"} 2023-07-24 17:08:47,335 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-24 17:08:47,337 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:47,338 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 83 msec 2023-07-24 17:08:47,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-24 17:08:47,371 INFO [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-24 17:08:47,372 INFO [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:47,372 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:47,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:47,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-24 17:08:47,380 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218527380"}]},"ts":"1690218527380"} 2023-07-24 17:08:47,383 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-24 17:08:47,386 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-24 17:08:47,388 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1470aa8eedfe37b6836860ac245f3204, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=4f6ce1604d7263e93b3764c8a3e39ed9, UNASSIGN}] 2023-07-24 17:08:47,389 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=4f6ce1604d7263e93b3764c8a3e39ed9, UNASSIGN 2023-07-24 17:08:47,391 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1470aa8eedfe37b6836860ac245f3204, UNASSIGN 2023-07-24 17:08:47,392 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=4f6ce1604d7263e93b3764c8a3e39ed9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:47,392 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690218505686.4f6ce1604d7263e93b3764c8a3e39ed9.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690218527392"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218527392"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218527392"}]},"ts":"1690218527392"} 2023-07-24 17:08:47,393 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=1470aa8eedfe37b6836860ac245f3204, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:47,393 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690218505686.1470aa8eedfe37b6836860ac245f3204.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690218527393"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218527393"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218527393"}]},"ts":"1690218527393"} 2023-07-24 17:08:47,394 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure 4f6ce1604d7263e93b3764c8a3e39ed9, server=jenkins-hbase4.apache.org,43483,1690218390174}] 2023-07-24 17:08:47,396 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure 1470aa8eedfe37b6836860ac245f3204, server=jenkins-hbase4.apache.org,37115,1690218390225}] 2023-07-24 17:08:47,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-24 17:08:47,547 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4f6ce1604d7263e93b3764c8a3e39ed9 2023-07-24 17:08:47,547 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4f6ce1604d7263e93b3764c8a3e39ed9, disabling compactions & flushes 2023-07-24 17:08:47,548 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1690218505686.4f6ce1604d7263e93b3764c8a3e39ed9. 2023-07-24 17:08:47,548 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690218505686.4f6ce1604d7263e93b3764c8a3e39ed9. 2023-07-24 17:08:47,548 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690218505686.4f6ce1604d7263e93b3764c8a3e39ed9. after waiting 0 ms 2023-07-24 17:08:47,548 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1690218505686.4f6ce1604d7263e93b3764c8a3e39ed9. 2023-07-24 17:08:47,548 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1470aa8eedfe37b6836860ac245f3204 2023-07-24 17:08:47,548 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1470aa8eedfe37b6836860ac245f3204, disabling compactions & flushes 2023-07-24 17:08:47,548 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1690218505686.1470aa8eedfe37b6836860ac245f3204. 2023-07-24 17:08:47,548 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690218505686.1470aa8eedfe37b6836860ac245f3204. 2023-07-24 17:08:47,548 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690218505686.1470aa8eedfe37b6836860ac245f3204. after waiting 0 ms 2023-07-24 17:08:47,548 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1690218505686.1470aa8eedfe37b6836860ac245f3204. 2023-07-24 17:08:47,566 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion/4f6ce1604d7263e93b3764c8a3e39ed9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 17:08:47,567 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 17:08:47,569 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1690218505686.4f6ce1604d7263e93b3764c8a3e39ed9. 2023-07-24 17:08:47,569 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4f6ce1604d7263e93b3764c8a3e39ed9: 2023-07-24 17:08:47,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithMergeRegion/1470aa8eedfe37b6836860ac245f3204/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 17:08:47,571 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 17:08:47,572 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1690218505686.1470aa8eedfe37b6836860ac245f3204. 2023-07-24 17:08:47,572 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1470aa8eedfe37b6836860ac245f3204: 2023-07-24 17:08:47,573 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4f6ce1604d7263e93b3764c8a3e39ed9 2023-07-24 17:08:47,573 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=4f6ce1604d7263e93b3764c8a3e39ed9, regionState=CLOSED 2023-07-24 17:08:47,574 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1470aa8eedfe37b6836860ac245f3204 2023-07-24 17:08:47,574 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690218505686.4f6ce1604d7263e93b3764c8a3e39ed9.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690218527573"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218527573"}]},"ts":"1690218527573"} 2023-07-24 17:08:47,575 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=1470aa8eedfe37b6836860ac245f3204, regionState=CLOSED 2023-07-24 17:08:47,575 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690218505686.1470aa8eedfe37b6836860ac245f3204.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690218527575"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218527575"}]},"ts":"1690218527575"} 2023-07-24 17:08:47,579 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=86 2023-07-24 17:08:47,579 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure 4f6ce1604d7263e93b3764c8a3e39ed9, server=jenkins-hbase4.apache.org,43483,1690218390174 in 183 msec 2023-07-24 17:08:47,587 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=85 2023-07-24 17:08:47,587 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure 1470aa8eedfe37b6836860ac245f3204, server=jenkins-hbase4.apache.org,37115,1690218390225 in 182 msec 2023-07-24 17:08:47,593 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=4f6ce1604d7263e93b3764c8a3e39ed9, UNASSIGN in 191 msec 2023-07-24 17:08:47,594 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-24 17:08:47,594 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1470aa8eedfe37b6836860ac245f3204, UNASSIGN in 200 msec 2023-07-24 17:08:47,603 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218527603"}]},"ts":"1690218527603"} 2023-07-24 17:08:47,605 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-24 17:08:47,606 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-24 17:08:47,618 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 245 msec 2023-07-24 17:08:47,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-24 17:08:47,682 INFO [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-24 17:08:47,683 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:47,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:47,686 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:47,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:47,687 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:47,689 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37115] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:47,692 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:47,692 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:47,692 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:47,692 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:47,692 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-24 17:08:47,692 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-24 17:08:47,692 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1470aa8eedfe37b6836860ac245f3204 2023-07-24 17:08:47,692 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/4f6ce1604d7263e93b3764c8a3e39ed9 2023-07-24 17:08:47,692 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-24 17:08:47,693 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-24 17:08:47,694 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/4f6ce1604d7263e93b3764c8a3e39ed9/cf, FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/4f6ce1604d7263e93b3764c8a3e39ed9/recovered.edits] 2023-07-24 17:08:47,695 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1470aa8eedfe37b6836860ac245f3204/cf, FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1470aa8eedfe37b6836860ac245f3204/recovered.edits] 2023-07-24 17:08:47,695 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:47,695 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:47,695 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:08:47,695 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:08:47,695 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:47,695 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:08:47,695 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:47,695 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:08:47,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-24 17:08:47,700 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/4f6ce1604d7263e93b3764c8a3e39ed9/cf/c49438d964124264a94c5443e4e5957d to hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/4f6ce1604d7263e93b3764c8a3e39ed9/cf/c49438d964124264a94c5443e4e5957d 2023-07-24 17:08:47,701 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1470aa8eedfe37b6836860ac245f3204/cf/2756d577d6b341bab4ab407f32d8f2b8 to hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/1470aa8eedfe37b6836860ac245f3204/cf/2756d577d6b341bab4ab407f32d8f2b8 2023-07-24 17:08:47,705 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/4f6ce1604d7263e93b3764c8a3e39ed9/recovered.edits/9.seqid to hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/4f6ce1604d7263e93b3764c8a3e39ed9/recovered.edits/9.seqid 2023-07-24 17:08:47,705 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1470aa8eedfe37b6836860ac245f3204/recovered.edits/9.seqid to hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/1470aa8eedfe37b6836860ac245f3204/recovered.edits/9.seqid 2023-07-24 17:08:47,705 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/4f6ce1604d7263e93b3764c8a3e39ed9 2023-07-24 17:08:47,706 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1470aa8eedfe37b6836860ac245f3204 2023-07-24 17:08:47,706 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-24 17:08:47,708 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:47,711 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-24 17:08:47,713 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-24 17:08:47,714 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:47,714 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-24 17:08:47,714 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690218505686.1470aa8eedfe37b6836860ac245f3204.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690218527714"}]},"ts":"9223372036854775807"} 2023-07-24 17:08:47,714 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690218505686.4f6ce1604d7263e93b3764c8a3e39ed9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690218527714"}]},"ts":"9223372036854775807"} 2023-07-24 17:08:47,716 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 17:08:47,716 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 1470aa8eedfe37b6836860ac245f3204, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690218505686.1470aa8eedfe37b6836860ac245f3204.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 4f6ce1604d7263e93b3764c8a3e39ed9, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690218505686.4f6ce1604d7263e93b3764c8a3e39ed9.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 17:08:47,716 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-24 17:08:47,716 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690218527716"}]},"ts":"9223372036854775807"} 2023-07-24 17:08:47,718 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-24 17:08:47,720 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:47,722 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 37 msec 2023-07-24 17:08:47,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-24 17:08:47,798 INFO [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-24 17:08:47,811 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-24 17:08:47,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:47,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-24 17:08:47,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:47,819 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-24 17:08:47,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:47,853 INFO [Listener at jenkins-hbase4.apache.org/34881] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=761 (was 745) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6b0b3732-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1022282582_1 at /127.0.0.1:39176 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-789691247_17 at /127.0.0.1:46390 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6b0b3732-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6b0b3732-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6b0b3732-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1822682432) connection to jenkins-hbase4.apache.org/172.31.14.131:35799 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-789691247_17 at /127.0.0.1:39210 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3952 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-789691247_17 at /127.0.0.1:57490 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6b0b3732-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1822682432) connection to jenkins-hbase4.apache.org/172.31.14.131:41869 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x6b0b3732-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=911 (was 892) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=660 (was 511) - SystemLoadAverage LEAK? -, ProcessCount=180 (was 181), AvailableMemoryMB=4891 (was 4858) - AvailableMemoryMB LEAK? - 2023-07-24 17:08:47,854 WARN [Listener at jenkins-hbase4.apache.org/34881] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-24 17:08:47,884 INFO [Listener at jenkins-hbase4.apache.org/34881] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=761, OpenFileDescriptor=911, MaxFileDescriptor=60000, SystemLoadAverage=660, ProcessCount=180, AvailableMemoryMB=4889 2023-07-24 17:08:47,884 WARN [Listener at jenkins-hbase4.apache.org/34881] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-24 17:08:47,886 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-24 17:08:47,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 17:08:47,890 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 17:08:47,890 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-24 17:08:47,891 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 17:08:47,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-24 17:08:47,893 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testEmptyExportFileSystemState/beb9eeaeabb06555da02ec79ef3c5c3c 2023-07-24 17:08:47,893 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testEmptyExportFileSystemState/e9886077fc24c15b640cbaeec9133cbf 2023-07-24 17:08:47,894 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testEmptyExportFileSystemState/e9886077fc24c15b640cbaeec9133cbf empty. 2023-07-24 17:08:47,894 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testEmptyExportFileSystemState/beb9eeaeabb06555da02ec79ef3c5c3c empty. 2023-07-24 17:08:47,894 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testEmptyExportFileSystemState/beb9eeaeabb06555da02ec79ef3c5c3c 2023-07-24 17:08:47,894 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testEmptyExportFileSystemState/e9886077fc24c15b640cbaeec9133cbf 2023-07-24 17:08:47,895 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-24 17:08:47,927 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-24 17:08:47,931 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => beb9eeaeabb06555da02ec79ef3c5c3c, NAME => 'testtb-testEmptyExportFileSystemState,1,1690218527886.beb9eeaeabb06555da02ec79ef3c5c3c.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp 2023-07-24 17:08:47,933 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => e9886077fc24c15b640cbaeec9133cbf, NAME => 'testtb-testEmptyExportFileSystemState,,1690218527886.e9886077fc24c15b640cbaeec9133cbf.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp 2023-07-24 17:08:47,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-24 17:08:48,063 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1690218527886.beb9eeaeabb06555da02ec79ef3c5c3c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:08:48,063 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing beb9eeaeabb06555da02ec79ef3c5c3c, disabling compactions & flushes 2023-07-24 17:08:48,064 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1690218527886.beb9eeaeabb06555da02ec79ef3c5c3c. 2023-07-24 17:08:48,064 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1690218527886.beb9eeaeabb06555da02ec79ef3c5c3c. 2023-07-24 17:08:48,064 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1690218527886.beb9eeaeabb06555da02ec79ef3c5c3c. after waiting 0 ms 2023-07-24 17:08:48,064 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1690218527886.beb9eeaeabb06555da02ec79ef3c5c3c. 2023-07-24 17:08:48,064 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1690218527886.beb9eeaeabb06555da02ec79ef3c5c3c. 2023-07-24 17:08:48,064 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for beb9eeaeabb06555da02ec79ef3c5c3c: 2023-07-24 17:08:48,064 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1690218527886.e9886077fc24c15b640cbaeec9133cbf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:08:48,065 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing e9886077fc24c15b640cbaeec9133cbf, disabling compactions & flushes 2023-07-24 17:08:48,065 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1690218527886.e9886077fc24c15b640cbaeec9133cbf. 2023-07-24 17:08:48,065 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1690218527886.e9886077fc24c15b640cbaeec9133cbf. 2023-07-24 17:08:48,065 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1690218527886.e9886077fc24c15b640cbaeec9133cbf. after waiting 0 ms 2023-07-24 17:08:48,065 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1690218527886.e9886077fc24c15b640cbaeec9133cbf. 2023-07-24 17:08:48,065 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1690218527886.e9886077fc24c15b640cbaeec9133cbf. 2023-07-24 17:08:48,065 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for e9886077fc24c15b640cbaeec9133cbf: 2023-07-24 17:08:48,068 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 17:08:48,069 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1690218527886.beb9eeaeabb06555da02ec79ef3c5c3c.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690218528068"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218528068"}]},"ts":"1690218528068"} 2023-07-24 17:08:48,069 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1690218527886.e9886077fc24c15b640cbaeec9133cbf.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690218528068"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218528068"}]},"ts":"1690218528068"} 2023-07-24 17:08:48,071 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 17:08:48,072 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 17:08:48,072 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218528072"}]},"ts":"1690218528072"} 2023-07-24 17:08:48,074 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-24 17:08:48,077 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 17:08:48,079 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 17:08:48,079 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 17:08:48,079 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 17:08:48,079 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 17:08:48,080 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e9886077fc24c15b640cbaeec9133cbf, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=beb9eeaeabb06555da02ec79ef3c5c3c, ASSIGN}] 2023-07-24 17:08:48,084 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=beb9eeaeabb06555da02ec79ef3c5c3c, ASSIGN 2023-07-24 17:08:48,084 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e9886077fc24c15b640cbaeec9133cbf, ASSIGN 2023-07-24 17:08:48,085 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e9886077fc24c15b640cbaeec9133cbf, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43483,1690218390174; forceNewPlan=false, retain=false 2023-07-24 17:08:48,085 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=beb9eeaeabb06555da02ec79ef3c5c3c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37115,1690218390225; forceNewPlan=false, retain=false 2023-07-24 17:08:48,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-24 17:08:48,236 INFO [jenkins-hbase4:46651] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 17:08:48,239 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=e9886077fc24c15b640cbaeec9133cbf, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:48,239 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=beb9eeaeabb06555da02ec79ef3c5c3c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:48,239 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1690218527886.e9886077fc24c15b640cbaeec9133cbf.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690218528239"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218528239"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218528239"}]},"ts":"1690218528239"} 2023-07-24 17:08:48,239 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1690218527886.beb9eeaeabb06555da02ec79ef3c5c3c.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690218528239"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218528239"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218528239"}]},"ts":"1690218528239"} 2023-07-24 17:08:48,241 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure e9886077fc24c15b640cbaeec9133cbf, server=jenkins-hbase4.apache.org,43483,1690218390174}] 2023-07-24 17:08:48,242 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure beb9eeaeabb06555da02ec79ef3c5c3c, server=jenkins-hbase4.apache.org,37115,1690218390225}] 2023-07-24 17:08:48,400 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1690218527886.beb9eeaeabb06555da02ec79ef3c5c3c. 2023-07-24 17:08:48,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => beb9eeaeabb06555da02ec79ef3c5c3c, NAME => 'testtb-testEmptyExportFileSystemState,1,1690218527886.beb9eeaeabb06555da02ec79ef3c5c3c.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 17:08:48,401 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1690218527886.e9886077fc24c15b640cbaeec9133cbf. 2023-07-24 17:08:48,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1690218527886.beb9eeaeabb06555da02ec79ef3c5c3c. service=AccessControlService 2023-07-24 17:08:48,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e9886077fc24c15b640cbaeec9133cbf, NAME => 'testtb-testEmptyExportFileSystemState,,1690218527886.e9886077fc24c15b640cbaeec9133cbf.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 17:08:48,401 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 17:08:48,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState beb9eeaeabb06555da02ec79ef3c5c3c 2023-07-24 17:08:48,402 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1690218527886.beb9eeaeabb06555da02ec79ef3c5c3c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:08:48,402 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for beb9eeaeabb06555da02ec79ef3c5c3c 2023-07-24 17:08:48,402 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for beb9eeaeabb06555da02ec79ef3c5c3c 2023-07-24 17:08:48,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1690218527886.e9886077fc24c15b640cbaeec9133cbf. service=AccessControlService 2023-07-24 17:08:48,402 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 17:08:48,402 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState e9886077fc24c15b640cbaeec9133cbf 2023-07-24 17:08:48,402 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1690218527886.e9886077fc24c15b640cbaeec9133cbf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:08:48,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e9886077fc24c15b640cbaeec9133cbf 2023-07-24 17:08:48,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e9886077fc24c15b640cbaeec9133cbf 2023-07-24 17:08:48,405 INFO [StoreOpener-beb9eeaeabb06555da02ec79ef3c5c3c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region beb9eeaeabb06555da02ec79ef3c5c3c 2023-07-24 17:08:48,405 INFO [StoreOpener-e9886077fc24c15b640cbaeec9133cbf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e9886077fc24c15b640cbaeec9133cbf 2023-07-24 17:08:48,407 DEBUG [StoreOpener-e9886077fc24c15b640cbaeec9133cbf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testEmptyExportFileSystemState/e9886077fc24c15b640cbaeec9133cbf/cf 2023-07-24 17:08:48,407 DEBUG [StoreOpener-e9886077fc24c15b640cbaeec9133cbf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testEmptyExportFileSystemState/e9886077fc24c15b640cbaeec9133cbf/cf 2023-07-24 17:08:48,407 DEBUG [StoreOpener-beb9eeaeabb06555da02ec79ef3c5c3c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testEmptyExportFileSystemState/beb9eeaeabb06555da02ec79ef3c5c3c/cf 2023-07-24 17:08:48,407 DEBUG [StoreOpener-beb9eeaeabb06555da02ec79ef3c5c3c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testEmptyExportFileSystemState/beb9eeaeabb06555da02ec79ef3c5c3c/cf 2023-07-24 17:08:48,408 INFO [StoreOpener-beb9eeaeabb06555da02ec79ef3c5c3c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region beb9eeaeabb06555da02ec79ef3c5c3c columnFamilyName cf 2023-07-24 17:08:48,408 INFO [StoreOpener-e9886077fc24c15b640cbaeec9133cbf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e9886077fc24c15b640cbaeec9133cbf columnFamilyName cf 2023-07-24 17:08:48,410 INFO [StoreOpener-e9886077fc24c15b640cbaeec9133cbf-1] regionserver.HStore(310): Store=e9886077fc24c15b640cbaeec9133cbf/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 17:08:48,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testEmptyExportFileSystemState/e9886077fc24c15b640cbaeec9133cbf 2023-07-24 17:08:48,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testEmptyExportFileSystemState/e9886077fc24c15b640cbaeec9133cbf 2023-07-24 17:08:48,412 INFO [StoreOpener-beb9eeaeabb06555da02ec79ef3c5c3c-1] regionserver.HStore(310): Store=beb9eeaeabb06555da02ec79ef3c5c3c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 17:08:48,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testEmptyExportFileSystemState/beb9eeaeabb06555da02ec79ef3c5c3c 2023-07-24 17:08:48,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testEmptyExportFileSystemState/beb9eeaeabb06555da02ec79ef3c5c3c 2023-07-24 17:08:48,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e9886077fc24c15b640cbaeec9133cbf 2023-07-24 17:08:48,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testEmptyExportFileSystemState/e9886077fc24c15b640cbaeec9133cbf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 17:08:48,420 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e9886077fc24c15b640cbaeec9133cbf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60024310, jitterRate=-0.10556808114051819}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 17:08:48,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e9886077fc24c15b640cbaeec9133cbf: 2023-07-24 17:08:48,420 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1690218527886.e9886077fc24c15b640cbaeec9133cbf., pid=93, masterSystemTime=1690218528397 2023-07-24 17:08:48,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1690218527886.e9886077fc24c15b640cbaeec9133cbf. 2023-07-24 17:08:48,422 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1690218527886.e9886077fc24c15b640cbaeec9133cbf. 2023-07-24 17:08:48,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for beb9eeaeabb06555da02ec79ef3c5c3c 2023-07-24 17:08:48,423 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=e9886077fc24c15b640cbaeec9133cbf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:48,423 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1690218527886.e9886077fc24c15b640cbaeec9133cbf.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690218528423"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690218528423"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690218528423"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690218528423"}]},"ts":"1690218528423"} 2023-07-24 17:08:48,429 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-24 17:08:48,429 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure e9886077fc24c15b640cbaeec9133cbf, server=jenkins-hbase4.apache.org,43483,1690218390174 in 184 msec 2023-07-24 17:08:48,430 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e9886077fc24c15b640cbaeec9133cbf, ASSIGN in 349 msec 2023-07-24 17:08:48,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testEmptyExportFileSystemState/beb9eeaeabb06555da02ec79ef3c5c3c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 17:08:48,439 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened beb9eeaeabb06555da02ec79ef3c5c3c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73783076, jitterRate=0.09945350885391235}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 17:08:48,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for beb9eeaeabb06555da02ec79ef3c5c3c: 2023-07-24 17:08:48,440 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1690218527886.beb9eeaeabb06555da02ec79ef3c5c3c., pid=94, masterSystemTime=1690218528397 2023-07-24 17:08:48,441 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1690218527886.beb9eeaeabb06555da02ec79ef3c5c3c. 2023-07-24 17:08:48,441 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1690218527886.beb9eeaeabb06555da02ec79ef3c5c3c. 2023-07-24 17:08:48,441 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=beb9eeaeabb06555da02ec79ef3c5c3c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:48,442 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1690218527886.beb9eeaeabb06555da02ec79ef3c5c3c.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690218528441"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690218528441"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690218528441"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690218528441"}]},"ts":"1690218528441"} 2023-07-24 17:08:48,447 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-24 17:08:48,447 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure beb9eeaeabb06555da02ec79ef3c5c3c, server=jenkins-hbase4.apache.org,37115,1690218390225 in 202 msec 2023-07-24 17:08:48,449 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-24 17:08:48,449 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=beb9eeaeabb06555da02ec79ef3c5c3c, ASSIGN in 367 msec 2023-07-24 17:08:48,450 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 17:08:48,450 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218528450"}]},"ts":"1690218528450"} 2023-07-24 17:08:48,452 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-24 17:08:48,455 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 17:08:48,455 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-24 17:08:48,457 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37115] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 17:08:48,460 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:08:48,460 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:08:48,460 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:08:48,460 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:08:48,462 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 17:08:48,462 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 17:08:48,462 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 17:08:48,462 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 17:08:48,463 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 576 msec 2023-07-24 17:08:48,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-24 17:08:48,496 INFO [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-24 17:08:48,496 DEBUG [Listener at jenkins-hbase4.apache.org/34881] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testEmptyExportFileSystemState get assigned. Timeout = 60000ms 2023-07-24 17:08:48,496 INFO [Listener at jenkins-hbase4.apache.org/34881] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 17:08:48,501 INFO [Listener at jenkins-hbase4.apache.org/34881] hbase.HBaseTestingUtility(3484): All regions for table testtb-testEmptyExportFileSystemState assigned to meta. Checking AM states. 2023-07-24 17:08:48,501 INFO [Listener at jenkins-hbase4.apache.org/34881] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 17:08:48,501 INFO [Listener at jenkins-hbase4.apache.org/34881] hbase.HBaseTestingUtility(3504): All regions for table testtb-testEmptyExportFileSystemState assigned. 2023-07-24 17:08:48,504 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 17:08:48,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690218528504 (current time:1690218528504). 2023-07-24 17:08:48,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 17:08:48,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(139): Connect 0x507ad0e5 to 127.0.0.1:49884 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:08:48,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3708c7ba, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:08:48,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:08:48,522 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59418, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:08:48,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x507ad0e5 to 127.0.0.1:49884 2023-07-24 17:08:48,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:08:48,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(139): Connect 0x2957c114 to 127.0.0.1:49884 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:08:48,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2facc123, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:08:48,637 DEBUG [hconnection-0x5e68e67b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:08:48,644 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59422, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:08:48,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2957c114 to 127.0.0.1:49884 2023-07-24 17:08:48,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:08:48,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 17:08:48,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 17:08:48,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 17:08:48,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 17:08:48,665 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 17:08:48,666 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690219128666 2023-07-24 17:08:48,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 17:08:48,666 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-24 17:08:48,669 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 17:08:48,669 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 17:08:48,669 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 17:08:48,670 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 17:08:48,673 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-07-24 17:08:48,677 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 17:08:48,677 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690219128677 2023-07-24 17:08:48,728 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,728 INFO [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-24 17:08:48,728 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:08:48,732 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-24 17:08:48,732 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-24 17:08:48,763 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,763 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,769 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:08:48,769 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:48,769 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:48,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:48,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:48,769 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:48,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:48,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:48,769 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:48,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:48,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:48,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 17:08:48,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 17:08:48,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,771 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:48,771 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:48,771 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 17:08:48,771 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,771 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,771 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,772 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:48,772 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 17:08:48,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-24 17:08:48,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-24 17:08:48,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-24 17:08:48,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,772 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 17:08:48,772 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 17:08:48,772 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 17:08:48,774 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,775 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 17:08:48,775 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:08:48,778 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,780 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 17:08:48,780 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 17:08:48,780 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:08:48,780 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 17:08:48,780 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37115,1690218390225' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 17:08:48,782 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:48,782 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:48,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:08:48,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:08:48,782 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,783 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,783 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:08:48,783 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 17:08:48,783 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:08:48,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:08:48,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:08:48,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,785 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 17:08:48,785 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 17:08:48,785 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43483,1690218390174' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 17:08:48,785 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 17:08:48,785 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 17:08:48,785 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44109,1690218390103' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 17:08:48,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:48,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:08:48,787 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:48,787 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,787 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37115,1690218390225' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-24 17:08:48,787 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f11a960[Count = 1] remaining members to acquire global barrier 2023-07-24 17:08:48,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:48,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:08:48,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:08:48,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:08:48,789 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:08:48,790 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,790 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:08:48,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,795 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,795 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:08:48,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:48,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:08:48,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:48,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:08:48,800 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43483,1690218390174' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-24 17:08:48,800 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f11a960[Count = 0] remaining members to acquire global barrier 2023-07-24 17:08:48,800 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-24 17:08:48,800 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,802 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,802 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,802 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,803 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 17:08:48,803 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:48,803 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 17:08:48,803 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 17:08:48,803 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1690218527886.e9886077fc24c15b640cbaeec9133cbf. 2023-07-24 17:08:48,803 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:48,803 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 17:08:48,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,803 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690218527886.e9886077fc24c15b640cbaeec9133cbf. started... 2023-07-24 17:08:48,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,805 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e9886077fc24c15b640cbaeec9133cbf: 2023-07-24 17:08:48,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,806 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 17:08:48,806 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1690218527886.e9886077fc24c15b640cbaeec9133cbf.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,806 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 17:08:48,806 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 17:08:48,809 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 17:08:48,809 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 17:08:48,810 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44109,1690218390103' in zk 2023-07-24 17:08:48,811 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 17:08:48,811 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:08:48,811 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 17:08:48,814 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 17:08:48,820 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 17:08:48,821 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1690218527886.beb9eeaeabb06555da02ec79ef3c5c3c. 2023-07-24 17:08:48,821 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690218527886.beb9eeaeabb06555da02ec79ef3c5c3c. started... 2023-07-24 17:08:48,826 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for beb9eeaeabb06555da02ec79ef3c5c3c: 2023-07-24 17:08:48,827 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1690218527886.beb9eeaeabb06555da02ec79ef3c5c3c.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,827 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 17:08:48,827 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 17:08:48,867 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690218527886.e9886077fc24c15b640cbaeec9133cbf. completed. 2023-07-24 17:08:48,867 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1690218527886.e9886077fc24c15b640cbaeec9133cbf. 2023-07-24 17:08:48,868 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 17:08:48,868 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 17:08:48,868 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:48,880 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 17:08:48,880 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43483,1690218390174' in zk 2023-07-24 17:08:48,883 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 17:08:48,883 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:08:48,883 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:48,883 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 17:08:48,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:48,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:08:48,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:08:48,885 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690218527886.beb9eeaeabb06555da02ec79ef3c5c3c. completed. 2023-07-24 17:08:48,885 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1690218527886.beb9eeaeabb06555da02ec79ef3c5c3c. 2023-07-24 17:08:48,886 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 17:08:48,886 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 17:08:48,886 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:48,886 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 17:08:48,886 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37115,1690218390225' in zk 2023-07-24 17:08:48,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:08:48,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:08:48,891 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:48,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,892 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 17:08:48,892 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:08:48,892 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 17:08:48,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:48,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:08:48,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:48,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:08:48,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:08:48,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:48,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:48,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,43483,1690218390174': 2023-07-24 17:08:48,896 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43483,1690218390174' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-24 17:08:48,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:48,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:08:48,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:08:48,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:08:48,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:08:48,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:48,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:08:48,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:48,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:08:48,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:08:48,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:48,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:48,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,37115,1690218390225': 2023-07-24 17:08:48,904 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37115,1690218390225' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-24 17:08:48,904 INFO [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-24 17:08:48,905 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 17:08:48,905 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 17:08:48,905 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,905 INFO [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 17:08:48,913 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,913 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,913 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,913 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,913 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:48,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:08:48,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:08:48,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,913 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:48,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,913 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:48,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:48,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:48,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:08:48,914 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:48,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:48,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:48,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:48,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:48,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,915 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:08:48,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:08:48,915 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:48,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:48,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:08:48,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:48,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:08:48,917 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:08:48,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,918 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:48,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:08:48,918 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:48,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:48,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:48,924 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:48,924 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:48,924 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:48,924 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:48,925 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:48,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:48,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:48,925 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:08:48,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:48,925 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:48,925 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:48,925 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:48,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:48,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:48,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:48,924 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:48,926 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:48,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:48,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:48,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:48,927 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:08:48,927 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:48,927 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,927 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:48,927 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,927 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:48,928 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:08:48,928 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,928 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,928 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,952 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,971 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-24 17:08:48,971 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,971 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:08:48,972 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:48,972 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1690218528667Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1690218528926 (+259 ms)Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1690218528927 (+1 ms)Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1690218528935 (+8 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1690218528947 (+12 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1690218528971 (+24 ms) 2023-07-24 17:08:48,976 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 17:08:48,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 17:08:48,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 17:08:48,978 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 308 msec 2023-07-24 17:08:48,983 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43483] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1690218527886.e9886077fc24c15b640cbaeec9133cbf. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 17:08:48,984 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37115] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1690218527886.beb9eeaeabb06555da02ec79ef3c5c3c. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 17:08:48,988 DEBUG [Listener at jenkins-hbase4.apache.org/34881] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-24 17:08:48,989 DEBUG [Listener at jenkins-hbase4.apache.org/34881] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1690218527886.e9886077fc24c15b640cbaeec9133cbf. 2023-07-24 17:08:48,989 INFO [Listener at jenkins-hbase4.apache.org/34881] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 17:08:49,013 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 17:08:49,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690218529013 (current time:1690218529013). 2023-07-24 17:08:49,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 17:08:49,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(139): Connect 0x481d1b82 to 127.0.0.1:49884 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:08:49,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@51df77c4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:08:49,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:08:49,029 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59432, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:08:49,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x481d1b82 to 127.0.0.1:49884 2023-07-24 17:08:49,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:08:49,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(139): Connect 0x07a46d4d to 127.0.0.1:49884 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:08:49,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@27c5a730, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:08:49,041 DEBUG [hconnection-0xd8e855b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:08:49,044 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59440, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:08:49,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x07a46d4d to 127.0.0.1:49884 2023-07-24 17:08:49,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:08:49,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 17:08:49,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 17:08:49,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 17:08:49,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 17:08:49,061 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 17:08:49,062 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690219129062 2023-07-24 17:08:49,062 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-24 17:08:49,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 17:08:49,064 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 17:08:49,064 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 17:08:49,067 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 17:08:49,067 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 17:08:49,068 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 12 msec 2023-07-24 17:08:49,070 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 17:08:49,070 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690219129070 2023-07-24 17:08:49,086 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,087 INFO [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-24 17:08:49,087 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:08:49,088 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-24 17:08:49,088 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-24 17:08:49,154 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,154 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,156 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:49,156 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:49,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:49,156 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:49,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:49,156 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:49,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:49,156 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:49,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:49,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,157 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:49,157 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 17:08:49,157 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:49,157 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,157 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:49,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:49,157 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-24 17:08:49,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-24 17:08:49,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,158 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 17:08:49,158 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 17:08:49,158 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,158 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,158 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 17:08:49,158 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,158 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:08:49,158 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 17:08:49,159 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:08:49,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-24 17:08:49,161 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 17:08:49,161 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 17:08:49,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,161 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 17:08:49,161 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 17:08:49,161 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37115,1690218390225' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 17:08:49,161 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43483,1690218390174' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 17:08:49,161 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 17:08:49,162 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,162 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 17:08:49,162 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:08:49,166 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 17:08:49,166 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 17:08:49,166 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44109,1690218390103' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 17:08:49,167 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:49,167 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:49,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:08:49,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:08:49,167 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:49,168 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:08:49,167 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 17:08:49,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 17:08:49,169 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 17:08:49,171 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,171 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,171 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:08:49,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:08:49,171 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,171 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:08:49,171 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,171 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:08:49,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:08:49,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:49,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:08:49,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:49,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:08:49,179 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37115,1690218390225' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-24 17:08:49,179 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ecb7e5[Count = 1] remaining members to acquire global barrier 2023-07-24 17:08:49,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:49,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:08:49,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:08:49,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:08:49,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:08:49,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:49,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:08:49,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:49,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:08:49,184 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43483,1690218390174' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-24 17:08:49,184 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ecb7e5[Count = 0] remaining members to acquire global barrier 2023-07-24 17:08:49,184 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-24 17:08:49,184 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,193 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,193 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,193 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,193 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 17:08:49,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,193 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 17:08:49,193 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 17:08:49,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,194 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:49,193 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44109,1690218390103' in zk 2023-07-24 17:08:49,194 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 17:08:49,194 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 17:08:49,195 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1690218527886.beb9eeaeabb06555da02ec79ef3c5c3c. 2023-07-24 17:08:49,195 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690218527886.beb9eeaeabb06555da02ec79ef3c5c3c. started... 2023-07-24 17:08:49,195 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 17:08:49,195 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:49,195 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 17:08:49,195 INFO [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] regionserver.HRegion(2745): Flushing beb9eeaeabb06555da02ec79ef3c5c3c 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-24 17:08:49,196 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 17:08:49,196 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 17:08:49,196 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1690218527886.e9886077fc24c15b640cbaeec9133cbf. 2023-07-24 17:08:49,196 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690218527886.e9886077fc24c15b640cbaeec9133cbf. started... 2023-07-24 17:08:49,196 INFO [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e9886077fc24c15b640cbaeec9133cbf 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-24 17:08:49,198 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 17:08:49,198 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:08:49,198 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 17:08:49,223 INFO [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testEmptyExportFileSystemState/e9886077fc24c15b640cbaeec9133cbf/.tmp/cf/5d2c634193504d709fccfa0206392465 2023-07-24 17:08:49,228 INFO [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testEmptyExportFileSystemState/beb9eeaeabb06555da02ec79ef3c5c3c/.tmp/cf/a8dbb13e76c24a6aaac3523ed21d045b 2023-07-24 17:08:49,237 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testEmptyExportFileSystemState/e9886077fc24c15b640cbaeec9133cbf/.tmp/cf/5d2c634193504d709fccfa0206392465 as hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testEmptyExportFileSystemState/e9886077fc24c15b640cbaeec9133cbf/cf/5d2c634193504d709fccfa0206392465 2023-07-24 17:08:49,241 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testEmptyExportFileSystemState/beb9eeaeabb06555da02ec79ef3c5c3c/.tmp/cf/a8dbb13e76c24a6aaac3523ed21d045b as hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testEmptyExportFileSystemState/beb9eeaeabb06555da02ec79ef3c5c3c/cf/a8dbb13e76c24a6aaac3523ed21d045b 2023-07-24 17:08:49,244 INFO [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testEmptyExportFileSystemState/e9886077fc24c15b640cbaeec9133cbf/cf/5d2c634193504d709fccfa0206392465, entries=3, sequenceid=6, filesize=5.0 K 2023-07-24 17:08:49,245 INFO [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for e9886077fc24c15b640cbaeec9133cbf in 49ms, sequenceid=6, compaction requested=false 2023-07-24 17:08:49,246 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-24 17:08:49,247 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e9886077fc24c15b640cbaeec9133cbf: 2023-07-24 17:08:49,247 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1690218527886.e9886077fc24c15b640cbaeec9133cbf.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,247 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 17:08:49,247 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testEmptyExportFileSystemState/e9886077fc24c15b640cbaeec9133cbf/cf/5d2c634193504d709fccfa0206392465] hfiles 2023-07-24 17:08:49,247 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testEmptyExportFileSystemState/e9886077fc24c15b640cbaeec9133cbf/cf/5d2c634193504d709fccfa0206392465 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,250 INFO [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testEmptyExportFileSystemState/beb9eeaeabb06555da02ec79ef3c5c3c/cf/a8dbb13e76c24a6aaac3523ed21d045b, entries=47, sequenceid=6, filesize=8.0 K 2023-07-24 17:08:49,251 INFO [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for beb9eeaeabb06555da02ec79ef3c5c3c in 56ms, sequenceid=6, compaction requested=false 2023-07-24 17:08:49,266 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for beb9eeaeabb06555da02ec79ef3c5c3c: 2023-07-24 17:08:49,266 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1690218527886.beb9eeaeabb06555da02ec79ef3c5c3c.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,266 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 17:08:49,266 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testEmptyExportFileSystemState/beb9eeaeabb06555da02ec79ef3c5c3c/cf/a8dbb13e76c24a6aaac3523ed21d045b] hfiles 2023-07-24 17:08:49,266 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testEmptyExportFileSystemState/beb9eeaeabb06555da02ec79ef3c5c3c/cf/a8dbb13e76c24a6aaac3523ed21d045b for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,304 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690218527886.e9886077fc24c15b640cbaeec9133cbf. completed. 2023-07-24 17:08:49,305 DEBUG [rs(jenkins-hbase4.apache.org,43483,1690218390174)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1690218527886.e9886077fc24c15b640cbaeec9133cbf. 2023-07-24 17:08:49,305 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 17:08:49,305 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 17:08:49,305 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:49,313 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 17:08:49,313 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43483,1690218390174' in zk 2023-07-24 17:08:49,316 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:49,316 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 17:08:49,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:49,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:08:49,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:08:49,316 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:08:49,316 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 17:08:49,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:08:49,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:08:49,320 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690218527886.beb9eeaeabb06555da02ec79ef3c5c3c. completed. 2023-07-24 17:08:49,320 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1690218527886.beb9eeaeabb06555da02ec79ef3c5c3c. 2023-07-24 17:08:49,320 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 17:08:49,320 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 17:08:49,320 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:49,320 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 17:08:49,320 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37115,1690218390225' in zk 2023-07-24 17:08:49,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:49,322 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:49,322 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 17:08:49,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:08:49,322 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:08:49,322 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 17:08:49,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:49,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:08:49,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:08:49,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:49,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:49,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,43483,1690218390174': 2023-07-24 17:08:49,333 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43483,1690218390174' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-24 17:08:49,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:49,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:08:49,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:08:49,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:08:49,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:08:49,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:49,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:08:49,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:49,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:08:49,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:08:49,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:49,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:49,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,37115,1690218390225': 2023-07-24 17:08:49,339 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37115,1690218390225' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-24 17:08:49,339 INFO [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-24 17:08:49,339 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 17:08:49,339 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 17:08:49,339 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,339 INFO [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 17:08:49,342 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,342 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,342 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:49,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,342 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,342 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:49,342 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:49,342 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:08:49,343 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:49,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:08:49,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:49,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:49,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:49,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:49,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:08:49,343 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:08:49,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:49,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:49,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,347 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:49,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:08:49,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:49,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:08:49,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:49,351 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:08:49,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:08:49,352 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:49,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,353 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:49,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:08:49,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:49,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:49,356 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:49,356 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:49,356 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:49,356 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:49,356 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:49,356 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:08:49,356 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:49,356 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,356 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:08:49,356 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,356 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:08:49,356 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:08:49,357 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,357 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:08:49,356 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:49,357 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,358 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:49,357 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,356 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:49,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:49,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:49,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:49,358 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:49,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:49,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:49,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:49,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:49,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:49,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:49,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:49,360 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,369 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:08:49,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 17:08:49,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 17:08:49,371 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 17:08:49,419 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,465 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-24 17:08:49,465 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,465 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,465 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1690218529062Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1690218529358 (+296 ms)Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1690218529359 (+1 ms)Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1690218529384 (+25 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1690218529410 (+26 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1690218529465 (+55 ms) 2023-07-24 17:08:49,468 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 17:08:49,470 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 405 msec 2023-07-24 17:08:49,671 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:08:49,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 17:08:49,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 17:08:49,673 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/export-test/export-1690218529673 2023-07-24 17:08:49,673 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:41733, tgtDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/export-test/export-1690218529673, rawTgtDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/export-test/export-1690218529673, srcFsUri=hdfs://localhost:41733, srcDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d 2023-07-24 17:08:49,705 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:41733, inputRoot=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d 2023-07-24 17:08:49,705 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1693769707_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/export-test/export-1690218529673, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/export-test/export-1690218529673/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,705 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:41733, inputRoot=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d, snapshotDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-24 17:08:49,719 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/export-test/export-1690218529673/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:49,768 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:49,769 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:49,769 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:49,769 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:49,770 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:49,770 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:49,770 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:49,867 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/hadoop-1406887898313846944.jar 2023-07-24 17:08:49,867 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:49,868 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:49,868 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:49,868 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:49,869 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:49,869 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:49,869 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 17:08:49,870 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 17:08:49,870 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 17:08:49,871 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 17:08:49,871 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 17:08:49,872 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 17:08:49,873 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 17:08:49,873 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 17:08:49,874 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 17:08:49,874 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 17:08:49,875 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 17:08:49,875 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 17:08:49,876 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 17:08:49,876 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 17:08:49,876 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 17:08:49,876 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 17:08:49,877 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 17:08:50,991 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397910_0005_000001 (auth:SIMPLE) 2023-07-24 17:08:51,327 WARN [Listener at jenkins-hbase4.apache.org/34881] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 17:08:51,330 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-24 17:08:51,469 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 17:08:51,469 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 17:08:51,777 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397910_0006_000001 (auth:SIMPLE) 2023-07-24 17:08:52,828 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 17:08:58,287 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397910_0006_000001 (auth:SIMPLE) 2023-07-24 17:09:00,775 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 17:09:00,776 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 17:09:00,782 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:09:00,782 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 17:09:00,784 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 17:09:00,784 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-789691247_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:09:00,785 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(367): hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-24 17:09:00,785 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(367): hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-24 17:09:00,785 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-789691247_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/export-test/export-1690218529673/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/export-test/export-1690218529673/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:09:00,785 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(367): hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/export-test/export-1690218529673/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-24 17:09:00,785 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(367): hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/export-test/export-1690218529673/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-24 17:09:00,790 INFO [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-24 17:09:00,790 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-24 17:09:00,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 17:09:00,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-24 17:09:00,795 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218540794"}]},"ts":"1690218540794"} 2023-07-24 17:09:00,797 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-24 17:09:00,800 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-24 17:09:00,802 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e9886077fc24c15b640cbaeec9133cbf, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=beb9eeaeabb06555da02ec79ef3c5c3c, UNASSIGN}] 2023-07-24 17:09:00,804 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e9886077fc24c15b640cbaeec9133cbf, UNASSIGN 2023-07-24 17:09:00,805 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=beb9eeaeabb06555da02ec79ef3c5c3c, UNASSIGN 2023-07-24 17:09:00,805 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=e9886077fc24c15b640cbaeec9133cbf, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:09:00,805 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=beb9eeaeabb06555da02ec79ef3c5c3c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:09:00,806 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1690218527886.e9886077fc24c15b640cbaeec9133cbf.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690218540805"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218540805"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218540805"}]},"ts":"1690218540805"} 2023-07-24 17:09:00,806 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1690218527886.beb9eeaeabb06555da02ec79ef3c5c3c.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690218540805"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218540805"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218540805"}]},"ts":"1690218540805"} 2023-07-24 17:09:00,807 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure e9886077fc24c15b640cbaeec9133cbf, server=jenkins-hbase4.apache.org,43483,1690218390174}] 2023-07-24 17:09:00,808 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure beb9eeaeabb06555da02ec79ef3c5c3c, server=jenkins-hbase4.apache.org,37115,1690218390225}] 2023-07-24 17:09:00,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-24 17:09:00,959 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e9886077fc24c15b640cbaeec9133cbf 2023-07-24 17:09:00,959 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close beb9eeaeabb06555da02ec79ef3c5c3c 2023-07-24 17:09:00,959 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e9886077fc24c15b640cbaeec9133cbf, disabling compactions & flushes 2023-07-24 17:09:00,959 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing beb9eeaeabb06555da02ec79ef3c5c3c, disabling compactions & flushes 2023-07-24 17:09:00,959 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1690218527886.e9886077fc24c15b640cbaeec9133cbf. 2023-07-24 17:09:00,960 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1690218527886.beb9eeaeabb06555da02ec79ef3c5c3c. 2023-07-24 17:09:00,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1690218527886.beb9eeaeabb06555da02ec79ef3c5c3c. 2023-07-24 17:09:00,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1690218527886.beb9eeaeabb06555da02ec79ef3c5c3c. after waiting 0 ms 2023-07-24 17:09:00,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1690218527886.beb9eeaeabb06555da02ec79ef3c5c3c. 2023-07-24 17:09:00,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1690218527886.e9886077fc24c15b640cbaeec9133cbf. 2023-07-24 17:09:00,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1690218527886.e9886077fc24c15b640cbaeec9133cbf. after waiting 0 ms 2023-07-24 17:09:00,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1690218527886.e9886077fc24c15b640cbaeec9133cbf. 2023-07-24 17:09:00,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testEmptyExportFileSystemState/e9886077fc24c15b640cbaeec9133cbf/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 17:09:00,985 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 17:09:00,988 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1690218527886.e9886077fc24c15b640cbaeec9133cbf. 2023-07-24 17:09:00,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e9886077fc24c15b640cbaeec9133cbf: 2023-07-24 17:09:00,990 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testEmptyExportFileSystemState/beb9eeaeabb06555da02ec79ef3c5c3c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 17:09:00,990 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e9886077fc24c15b640cbaeec9133cbf 2023-07-24 17:09:00,990 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 17:09:00,990 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=e9886077fc24c15b640cbaeec9133cbf, regionState=CLOSED 2023-07-24 17:09:00,991 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1690218527886.e9886077fc24c15b640cbaeec9133cbf.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690218540990"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218540990"}]},"ts":"1690218540990"} 2023-07-24 17:09:00,992 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1690218527886.beb9eeaeabb06555da02ec79ef3c5c3c. 2023-07-24 17:09:00,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for beb9eeaeabb06555da02ec79ef3c5c3c: 2023-07-24 17:09:01,000 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed beb9eeaeabb06555da02ec79ef3c5c3c 2023-07-24 17:09:01,001 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=beb9eeaeabb06555da02ec79ef3c5c3c, regionState=CLOSED 2023-07-24 17:09:01,001 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1690218527886.beb9eeaeabb06555da02ec79ef3c5c3c.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690218541001"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218541001"}]},"ts":"1690218541001"} 2023-07-24 17:09:01,005 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-24 17:09:01,005 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure e9886077fc24c15b640cbaeec9133cbf, server=jenkins-hbase4.apache.org,43483,1690218390174 in 193 msec 2023-07-24 17:09:01,007 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e9886077fc24c15b640cbaeec9133cbf, UNASSIGN in 203 msec 2023-07-24 17:09:01,007 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-24 17:09:01,007 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure beb9eeaeabb06555da02ec79ef3c5c3c, server=jenkins-hbase4.apache.org,37115,1690218390225 in 196 msec 2023-07-24 17:09:01,008 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-24 17:09:01,009 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=beb9eeaeabb06555da02ec79ef3c5c3c, UNASSIGN in 205 msec 2023-07-24 17:09:01,009 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218541009"}]},"ts":"1690218541009"} 2023-07-24 17:09:01,010 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-24 17:09:01,012 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-24 17:09:01,014 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 223 msec 2023-07-24 17:09:01,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-24 17:09:01,097 INFO [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-24 17:09:01,097 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-24 17:09:01,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 17:09:01,100 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 17:09:01,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-24 17:09:01,101 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 17:09:01,104 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37115] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-24 17:09:01,107 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testEmptyExportFileSystemState/beb9eeaeabb06555da02ec79ef3c5c3c 2023-07-24 17:09:01,107 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testEmptyExportFileSystemState/e9886077fc24c15b640cbaeec9133cbf 2023-07-24 17:09:01,108 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 17:09:01,108 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 17:09:01,108 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 17:09:01,108 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 17:09:01,109 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-24 17:09:01,109 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-24 17:09:01,110 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testEmptyExportFileSystemState/e9886077fc24c15b640cbaeec9133cbf/cf, FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testEmptyExportFileSystemState/e9886077fc24c15b640cbaeec9133cbf/recovered.edits] 2023-07-24 17:09:01,110 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testEmptyExportFileSystemState/beb9eeaeabb06555da02ec79ef3c5c3c/cf, FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testEmptyExportFileSystemState/beb9eeaeabb06555da02ec79ef3c5c3c/recovered.edits] 2023-07-24 17:09:01,110 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 17:09:01,110 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-07-24 17:09:01,110 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 17:09:01,110 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-07-24 17:09:01,110 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 17:09:01,110 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:09:01,110 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:09:01,110 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:09:01,112 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 17:09:01,112 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:09:01,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-24 17:09:01,120 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testEmptyExportFileSystemState/beb9eeaeabb06555da02ec79ef3c5c3c/cf/a8dbb13e76c24a6aaac3523ed21d045b to hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/archive/data/default/testtb-testEmptyExportFileSystemState/beb9eeaeabb06555da02ec79ef3c5c3c/cf/a8dbb13e76c24a6aaac3523ed21d045b 2023-07-24 17:09:01,120 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testEmptyExportFileSystemState/e9886077fc24c15b640cbaeec9133cbf/cf/5d2c634193504d709fccfa0206392465 to hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/archive/data/default/testtb-testEmptyExportFileSystemState/e9886077fc24c15b640cbaeec9133cbf/cf/5d2c634193504d709fccfa0206392465 2023-07-24 17:09:01,125 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testEmptyExportFileSystemState/beb9eeaeabb06555da02ec79ef3c5c3c/recovered.edits/9.seqid to hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/archive/data/default/testtb-testEmptyExportFileSystemState/beb9eeaeabb06555da02ec79ef3c5c3c/recovered.edits/9.seqid 2023-07-24 17:09:01,125 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testEmptyExportFileSystemState/e9886077fc24c15b640cbaeec9133cbf/recovered.edits/9.seqid to hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/archive/data/default/testtb-testEmptyExportFileSystemState/e9886077fc24c15b640cbaeec9133cbf/recovered.edits/9.seqid 2023-07-24 17:09:01,125 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testEmptyExportFileSystemState/beb9eeaeabb06555da02ec79ef3c5c3c 2023-07-24 17:09:01,126 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testEmptyExportFileSystemState/e9886077fc24c15b640cbaeec9133cbf 2023-07-24 17:09:01,126 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-24 17:09:01,128 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 17:09:01,130 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-24 17:09:01,132 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-24 17:09:01,133 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 17:09:01,133 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-24 17:09:01,133 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1690218527886.e9886077fc24c15b640cbaeec9133cbf.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690218541133"}]},"ts":"9223372036854775807"} 2023-07-24 17:09:01,133 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1690218527886.beb9eeaeabb06555da02ec79ef3c5c3c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690218541133"}]},"ts":"9223372036854775807"} 2023-07-24 17:09:01,135 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 17:09:01,135 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e9886077fc24c15b640cbaeec9133cbf, NAME => 'testtb-testEmptyExportFileSystemState,,1690218527886.e9886077fc24c15b640cbaeec9133cbf.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => beb9eeaeabb06555da02ec79ef3c5c3c, NAME => 'testtb-testEmptyExportFileSystemState,1,1690218527886.beb9eeaeabb06555da02ec79ef3c5c3c.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 17:09:01,135 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-24 17:09:01,135 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690218541135"}]},"ts":"9223372036854775807"} 2023-07-24 17:09:01,137 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-24 17:09:01,138 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 17:09:01,140 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 42 msec 2023-07-24 17:09:01,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-24 17:09:01,214 INFO [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-24 17:09:01,222 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-24 17:09:01,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:09:01,226 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-24 17:09:01,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-24 17:09:01,256 INFO [Listener at jenkins-hbase4.apache.org/34881] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=766 (was 761) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-789691247_17 at /127.0.0.1:48018 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4719 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1822682432) connection to jenkins-hbase4.apache.org/172.31.14.131:42877 from appattempt_1690218397910_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-789691247_17 at /127.0.0.1:35064 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-789691247_17 at /127.0.0.1:52308 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_140330241_1 at /127.0.0.1:55300 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6b0b3732-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6b0b3732-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6b0b3732-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1822682432) connection to jenkins-hbase4.apache.org/172.31.14.131:35889 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6b0b3732-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=916 (was 911) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=637 (was 660), ProcessCount=183 (was 180) - ProcessCount LEAK? -, AvailableMemoryMB=3974 (was 4889) 2023-07-24 17:09:01,256 WARN [Listener at jenkins-hbase4.apache.org/34881] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-07-24 17:09:01,281 INFO [Listener at jenkins-hbase4.apache.org/34881] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=766, OpenFileDescriptor=916, MaxFileDescriptor=60000, SystemLoadAverage=637, ProcessCount=185, AvailableMemoryMB=3974 2023-07-24 17:09:01,281 WARN [Listener at jenkins-hbase4.apache.org/34881] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-07-24 17:09:01,283 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-24 17:09:01,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:01,286 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 17:09:01,286 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-24 17:09:01,287 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 17:09:01,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-24 17:09:01,289 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6a66e336162445896a567a53203d4807 2023-07-24 17:09:01,289 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bfc53ec1e98c9301f790bcff7c7c50e0 2023-07-24 17:09:01,289 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6a66e336162445896a567a53203d4807 empty. 2023-07-24 17:09:01,289 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bfc53ec1e98c9301f790bcff7c7c50e0 empty. 2023-07-24 17:09:01,290 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6a66e336162445896a567a53203d4807 2023-07-24 17:09:01,290 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bfc53ec1e98c9301f790bcff7c7c50e0 2023-07-24 17:09:01,290 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-24 17:09:01,299 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-24 17:09:01,300 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6a66e336162445896a567a53203d4807, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690218541283.6a66e336162445896a567a53203d4807.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp 2023-07-24 17:09:01,300 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => bfc53ec1e98c9301f790bcff7c7c50e0, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690218541283.bfc53ec1e98c9301f790bcff7c7c50e0.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp 2023-07-24 17:09:01,319 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1690218541283.bfc53ec1e98c9301f790bcff7c7c50e0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:09:01,320 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing bfc53ec1e98c9301f790bcff7c7c50e0, disabling compactions & flushes 2023-07-24 17:09:01,320 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1690218541283.bfc53ec1e98c9301f790bcff7c7c50e0. 2023-07-24 17:09:01,320 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690218541283.bfc53ec1e98c9301f790bcff7c7c50e0. 2023-07-24 17:09:01,320 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690218541283.bfc53ec1e98c9301f790bcff7c7c50e0. after waiting 0 ms 2023-07-24 17:09:01,320 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1690218541283.bfc53ec1e98c9301f790bcff7c7c50e0. 2023-07-24 17:09:01,320 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1690218541283.bfc53ec1e98c9301f790bcff7c7c50e0. 2023-07-24 17:09:01,320 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for bfc53ec1e98c9301f790bcff7c7c50e0: 2023-07-24 17:09:01,327 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1690218541283.6a66e336162445896a567a53203d4807.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:09:01,327 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 6a66e336162445896a567a53203d4807, disabling compactions & flushes 2023-07-24 17:09:01,327 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1690218541283.6a66e336162445896a567a53203d4807. 2023-07-24 17:09:01,328 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690218541283.6a66e336162445896a567a53203d4807. 2023-07-24 17:09:01,328 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690218541283.6a66e336162445896a567a53203d4807. after waiting 0 ms 2023-07-24 17:09:01,328 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1690218541283.6a66e336162445896a567a53203d4807. 2023-07-24 17:09:01,328 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1690218541283.6a66e336162445896a567a53203d4807. 2023-07-24 17:09:01,328 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 6a66e336162445896a567a53203d4807: 2023-07-24 17:09:01,330 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 17:09:01,331 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690218541283.bfc53ec1e98c9301f790bcff7c7c50e0.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690218541331"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218541331"}]},"ts":"1690218541331"} 2023-07-24 17:09:01,331 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690218541283.6a66e336162445896a567a53203d4807.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690218541331"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218541331"}]},"ts":"1690218541331"} 2023-07-24 17:09:01,334 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 17:09:01,335 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 17:09:01,335 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218541335"}]},"ts":"1690218541335"} 2023-07-24 17:09:01,337 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-24 17:09:01,342 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 17:09:01,343 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 17:09:01,343 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 17:09:01,343 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 17:09:01,343 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 17:09:01,343 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6a66e336162445896a567a53203d4807, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=bfc53ec1e98c9301f790bcff7c7c50e0, ASSIGN}] 2023-07-24 17:09:01,346 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6a66e336162445896a567a53203d4807, ASSIGN 2023-07-24 17:09:01,347 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=bfc53ec1e98c9301f790bcff7c7c50e0, ASSIGN 2023-07-24 17:09:01,348 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6a66e336162445896a567a53203d4807, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37115,1690218390225; forceNewPlan=false, retain=false 2023-07-24 17:09:01,350 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=bfc53ec1e98c9301f790bcff7c7c50e0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44109,1690218390103; forceNewPlan=false, retain=false 2023-07-24 17:09:01,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-24 17:09:01,501 INFO [jenkins-hbase4:46651] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 17:09:01,504 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=bfc53ec1e98c9301f790bcff7c7c50e0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:09:01,504 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=6a66e336162445896a567a53203d4807, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:09:01,504 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690218541283.bfc53ec1e98c9301f790bcff7c7c50e0.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690218541504"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218541504"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218541504"}]},"ts":"1690218541504"} 2023-07-24 17:09:01,504 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690218541283.6a66e336162445896a567a53203d4807.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690218541504"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218541504"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218541504"}]},"ts":"1690218541504"} 2023-07-24 17:09:01,507 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure bfc53ec1e98c9301f790bcff7c7c50e0, server=jenkins-hbase4.apache.org,44109,1690218390103}] 2023-07-24 17:09:01,508 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 6a66e336162445896a567a53203d4807, server=jenkins-hbase4.apache.org,37115,1690218390225}] 2023-07-24 17:09:01,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-24 17:09:01,668 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1690218541283.6a66e336162445896a567a53203d4807. 2023-07-24 17:09:01,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6a66e336162445896a567a53203d4807, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690218541283.6a66e336162445896a567a53203d4807.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 17:09:01,668 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1690218541283.bfc53ec1e98c9301f790bcff7c7c50e0. 2023-07-24 17:09:01,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bfc53ec1e98c9301f790bcff7c7c50e0, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690218541283.bfc53ec1e98c9301f790bcff7c7c50e0.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 17:09:01,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1690218541283.6a66e336162445896a567a53203d4807. service=AccessControlService 2023-07-24 17:09:01,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1690218541283.bfc53ec1e98c9301f790bcff7c7c50e0. service=AccessControlService 2023-07-24 17:09:01,669 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 17:09:01,669 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 17:09:01,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 6a66e336162445896a567a53203d4807 2023-07-24 17:09:01,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp bfc53ec1e98c9301f790bcff7c7c50e0 2023-07-24 17:09:01,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1690218541283.6a66e336162445896a567a53203d4807.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:09:01,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1690218541283.bfc53ec1e98c9301f790bcff7c7c50e0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:09:01,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6a66e336162445896a567a53203d4807 2023-07-24 17:09:01,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for bfc53ec1e98c9301f790bcff7c7c50e0 2023-07-24 17:09:01,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for bfc53ec1e98c9301f790bcff7c7c50e0 2023-07-24 17:09:01,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6a66e336162445896a567a53203d4807 2023-07-24 17:09:01,670 INFO [StoreOpener-bfc53ec1e98c9301f790bcff7c7c50e0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region bfc53ec1e98c9301f790bcff7c7c50e0 2023-07-24 17:09:01,671 INFO [StoreOpener-6a66e336162445896a567a53203d4807-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6a66e336162445896a567a53203d4807 2023-07-24 17:09:01,672 DEBUG [StoreOpener-bfc53ec1e98c9301f790bcff7c7c50e0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithSkipTmp/bfc53ec1e98c9301f790bcff7c7c50e0/cf 2023-07-24 17:09:01,672 DEBUG [StoreOpener-bfc53ec1e98c9301f790bcff7c7c50e0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithSkipTmp/bfc53ec1e98c9301f790bcff7c7c50e0/cf 2023-07-24 17:09:01,672 DEBUG [StoreOpener-6a66e336162445896a567a53203d4807-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithSkipTmp/6a66e336162445896a567a53203d4807/cf 2023-07-24 17:09:01,672 DEBUG [StoreOpener-6a66e336162445896a567a53203d4807-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithSkipTmp/6a66e336162445896a567a53203d4807/cf 2023-07-24 17:09:01,672 INFO [StoreOpener-bfc53ec1e98c9301f790bcff7c7c50e0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bfc53ec1e98c9301f790bcff7c7c50e0 columnFamilyName cf 2023-07-24 17:09:01,673 INFO [StoreOpener-6a66e336162445896a567a53203d4807-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6a66e336162445896a567a53203d4807 columnFamilyName cf 2023-07-24 17:09:01,673 INFO [StoreOpener-bfc53ec1e98c9301f790bcff7c7c50e0-1] regionserver.HStore(310): Store=bfc53ec1e98c9301f790bcff7c7c50e0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 17:09:01,673 INFO [StoreOpener-6a66e336162445896a567a53203d4807-1] regionserver.HStore(310): Store=6a66e336162445896a567a53203d4807/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 17:09:01,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithSkipTmp/bfc53ec1e98c9301f790bcff7c7c50e0 2023-07-24 17:09:01,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithSkipTmp/6a66e336162445896a567a53203d4807 2023-07-24 17:09:01,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithSkipTmp/bfc53ec1e98c9301f790bcff7c7c50e0 2023-07-24 17:09:01,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithSkipTmp/6a66e336162445896a567a53203d4807 2023-07-24 17:09:01,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for bfc53ec1e98c9301f790bcff7c7c50e0 2023-07-24 17:09:01,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6a66e336162445896a567a53203d4807 2023-07-24 17:09:01,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithSkipTmp/bfc53ec1e98c9301f790bcff7c7c50e0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 17:09:01,680 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened bfc53ec1e98c9301f790bcff7c7c50e0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61593999, jitterRate=-0.08217789232730865}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 17:09:01,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for bfc53ec1e98c9301f790bcff7c7c50e0: 2023-07-24 17:09:01,681 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1690218541283.bfc53ec1e98c9301f790bcff7c7c50e0., pid=108, masterSystemTime=1690218541662 2023-07-24 17:09:01,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1690218541283.bfc53ec1e98c9301f790bcff7c7c50e0. 2023-07-24 17:09:01,682 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1690218541283.bfc53ec1e98c9301f790bcff7c7c50e0. 2023-07-24 17:09:01,683 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=bfc53ec1e98c9301f790bcff7c7c50e0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:09:01,683 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690218541283.bfc53ec1e98c9301f790bcff7c7c50e0.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690218541682"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690218541682"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690218541682"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690218541682"}]},"ts":"1690218541682"} 2023-07-24 17:09:01,686 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-24 17:09:01,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithSkipTmp/6a66e336162445896a567a53203d4807/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 17:09:01,686 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure bfc53ec1e98c9301f790bcff7c7c50e0, server=jenkins-hbase4.apache.org,44109,1690218390103 in 178 msec 2023-07-24 17:09:01,687 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6a66e336162445896a567a53203d4807; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67316765, jitterRate=0.0030979663133621216}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 17:09:01,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6a66e336162445896a567a53203d4807: 2023-07-24 17:09:01,687 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1690218541283.6a66e336162445896a567a53203d4807., pid=109, masterSystemTime=1690218541662 2023-07-24 17:09:01,688 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=bfc53ec1e98c9301f790bcff7c7c50e0, ASSIGN in 343 msec 2023-07-24 17:09:01,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1690218541283.6a66e336162445896a567a53203d4807. 2023-07-24 17:09:01,689 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1690218541283.6a66e336162445896a567a53203d4807. 2023-07-24 17:09:01,689 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=6a66e336162445896a567a53203d4807, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:09:01,689 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690218541283.6a66e336162445896a567a53203d4807.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690218541689"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690218541689"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690218541689"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690218541689"}]},"ts":"1690218541689"} 2023-07-24 17:09:01,695 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-24 17:09:01,695 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 6a66e336162445896a567a53203d4807, server=jenkins-hbase4.apache.org,37115,1690218390225 in 183 msec 2023-07-24 17:09:01,697 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-24 17:09:01,697 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6a66e336162445896a567a53203d4807, ASSIGN in 352 msec 2023-07-24 17:09:01,698 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 17:09:01,698 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218541698"}]},"ts":"1690218541698"} 2023-07-24 17:09:01,699 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-24 17:09:01,702 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 17:09:01,702 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-24 17:09:01,704 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37115] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-24 17:09:01,705 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:09:01,705 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:09:01,705 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:09:01,705 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:09:01,707 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-24 17:09:01,707 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-24 17:09:01,708 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-24 17:09:01,708 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-24 17:09:01,709 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 425 msec 2023-07-24 17:09:01,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-24 17:09:01,894 INFO [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-24 17:09:01,894 DEBUG [Listener at jenkins-hbase4.apache.org/34881] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithSkipTmp get assigned. Timeout = 60000ms 2023-07-24 17:09:01,894 INFO [Listener at jenkins-hbase4.apache.org/34881] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 17:09:01,898 INFO [Listener at jenkins-hbase4.apache.org/34881] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned to meta. Checking AM states. 2023-07-24 17:09:01,898 INFO [Listener at jenkins-hbase4.apache.org/34881] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 17:09:01,899 INFO [Listener at jenkins-hbase4.apache.org/34881] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned. 2023-07-24 17:09:01,901 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 17:09:01,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690218541901 (current time:1690218541901). 2023-07-24 17:09:01,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 17:09:01,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(139): Connect 0x76129a30 to 127.0.0.1:49884 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:09:01,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ba23d79, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:09:01,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:09:01,918 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55918, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:09:01,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x76129a30 to 127.0.0.1:49884 2023-07-24 17:09:01,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:09:01,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(139): Connect 0x63ba400b to 127.0.0.1:49884 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:09:01,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@11b9556, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:09:01,932 DEBUG [hconnection-0x5b8829f9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:09:01,933 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55920, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:09:01,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x63ba400b to 127.0.0.1:49884 2023-07-24 17:09:01,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:09:01,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-24 17:09:01,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 17:09:01,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 17:09:01,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 17:09:01,944 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 17:09:01,945 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1690219141945 2023-07-24 17:09:01,945 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:01,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 17:09:01,946 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 17:09:01,946 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 17:09:01,947 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 17:09:01,947 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 17:09:01,948 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-07-24 17:09:01,949 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 17:09:01,950 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1690219141950 2023-07-24 17:09:01,994 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:01,995 INFO [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-24 17:09:01,995 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:09:01,996 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-24 17:09:01,996 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-24 17:09:01,997 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:01,997 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:01,999 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:09:01,999 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:09:01,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:09:01,999 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:09:01,999 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:09:01,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:09:01,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:09:01,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:09:01,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:09:01,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:09:01,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,000 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:09:02,000 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:09:02,000 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,000 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,000 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,000 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:09:02,000 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 17:09:02,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-24 17:09:02,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,001 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 17:09:02,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-24 17:09:02,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-24 17:09:02,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,001 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,001 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 17:09:02,001 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 17:09:02,001 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 17:09:02,001 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:09:02,001 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,003 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,003 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 17:09:02,003 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 17:09:02,003 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:09:02,003 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 17:09:02,004 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 17:09:02,005 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 17:09:02,003 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:09:02,005 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44109,1690218390103' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 17:09:02,005 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 17:09:02,006 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 17:09:02,006 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 17:09:02,006 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43483,1690218390174' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 17:09:02,006 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37115,1690218390225' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 17:09:02,013 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,013 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,013 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:09:02,014 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:09:02,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:09:02,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:09:02,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:09:02,014 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,014 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:09:02,014 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,014 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:09:02,014 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:09:02,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:09:02,015 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,015 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:09:02,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:09:02,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:09:02,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:09:02,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:09:02,017 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44109,1690218390103' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-24 17:09:02,017 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d738367[Count = 1] remaining members to acquire global barrier 2023-07-24 17:09:02,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:09:02,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:09:02,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:09:02,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:09:02,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:09:02,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:09:02,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:09:02,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:09:02,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:09:02,020 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37115,1690218390225' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-24 17:09:02,020 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d738367[Count = 0] remaining members to acquire global barrier 2023-07-24 17:09:02,020 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-24 17:09:02,020 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,021 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,021 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,022 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,022 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:09:02,022 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 17:09:02,022 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:09:02,022 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 17:09:02,022 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 17:09:02,023 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 17:09:02,023 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43483,1690218390174' in zk 2023-07-24 17:09:02,022 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 17:09:02,026 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 17:09:02,037 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690218541283.bfc53ec1e98c9301f790bcff7c7c50e0. 2023-07-24 17:09:02,037 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 17:09:02,037 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690218541283.6a66e336162445896a567a53203d4807. 2023-07-24 17:09:02,037 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:09:02,037 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690218541283.6a66e336162445896a567a53203d4807. started... 2023-07-24 17:09:02,037 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 17:09:02,037 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 17:09:02,039 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 17:09:02,037 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690218541283.bfc53ec1e98c9301f790bcff7c7c50e0. started... 2023-07-24 17:09:02,037 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 17:09:02,041 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6a66e336162445896a567a53203d4807: 2023-07-24 17:09:02,042 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bfc53ec1e98c9301f790bcff7c7c50e0: 2023-07-24 17:09:02,042 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1690218541283.6a66e336162445896a567a53203d4807.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,042 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1690218541283.bfc53ec1e98c9301f790bcff7c7c50e0.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,042 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 17:09:02,042 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 17:09:02,042 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 17:09:02,042 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 17:09:02,046 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:09:02,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 17:09:02,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-24 17:09:02,047 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 17:09:02,068 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690218541283.6a66e336162445896a567a53203d4807. completed. 2023-07-24 17:09:02,068 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690218541283.6a66e336162445896a567a53203d4807. 2023-07-24 17:09:02,068 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 17:09:02,068 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 17:09:02,068 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:09:02,068 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 17:09:02,068 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37115,1690218390225' in zk 2023-07-24 17:09:02,070 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690218541283.bfc53ec1e98c9301f790bcff7c7c50e0. completed. 2023-07-24 17:09:02,070 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690218541283.bfc53ec1e98c9301f790bcff7c7c50e0. 2023-07-24 17:09:02,070 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 17:09:02,070 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 17:09:02,070 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:09:02,070 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 17:09:02,070 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,44109,1690218390103' in zk 2023-07-24 17:09:02,070 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 17:09:02,070 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:09:02,070 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 17:09:02,070 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:09:02,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:09:02,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:09:02,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:09:02,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:09:02,074 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:09:02,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:09:02,074 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 17:09:02,074 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:09:02,074 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 17:09:02,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:09:02,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:09:02,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:09:02,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:09:02,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:09:02,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:09:02,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:09:02,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,37115,1690218390225': 2023-07-24 17:09:02,079 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37115,1690218390225' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-24 17:09:02,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:09:02,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:09:02,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:09:02,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:09:02,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:09:02,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:09:02,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:09:02,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:09:02,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:09:02,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:09:02,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:09:02,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:09:02,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,44109,1690218390103': 2023-07-24 17:09:02,083 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44109,1690218390103' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-24 17:09:02,083 INFO [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-24 17:09:02,083 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 17:09:02,083 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 17:09:02,083 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,083 INFO [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 17:09:02,085 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,086 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:09:02,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:09:02,086 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,086 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:09:02,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,086 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:09:02,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,086 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,086 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:09:02,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:09:02,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:09:02,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:09:02,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:09:02,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:09:02,087 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:09:02,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:09:02,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:09:02,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,088 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:09:02,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:09:02,089 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:09:02,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:09:02,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:09:02,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:09:02,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:09:02,091 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:09:02,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,091 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:09:02,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:09:02,091 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:09:02,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:09:02,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:09:02,096 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:09:02,096 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:09:02,096 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:09:02,096 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:09:02,096 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:09:02,096 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:09:02,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:09:02,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:09:02,096 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:09:02,096 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:09:02,096 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,096 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:09:02,096 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:09:02,096 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:09:02,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:09:02,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:09:02,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:09:02,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:09:02,096 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:09:02,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:09:02,100 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:09:02,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:09:02,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:09:02,100 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,100 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:09:02,100 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,100 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:09:02,100 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:09:02,100 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,100 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,151 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,197 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-24 17:09:02,197 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,198 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,198 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1690218541945Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690218542096 (+151 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690218542097 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690218542103 (+6 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690218542111 (+8 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1690218542197 (+86 ms) 2023-07-24 17:09:02,202 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 17:09:02,211 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 256 msec 2023-07-24 17:09:02,248 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:09:02,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 17:09:02,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 17:09:02,257 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37115] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1690218541283.6a66e336162445896a567a53203d4807. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 17:09:02,258 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44109] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1690218541283.bfc53ec1e98c9301f790bcff7c7c50e0. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 17:09:02,261 DEBUG [Listener at jenkins-hbase4.apache.org/34881] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,262 DEBUG [Listener at jenkins-hbase4.apache.org/34881] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1690218541283.6a66e336162445896a567a53203d4807. 2023-07-24 17:09:02,262 INFO [Listener at jenkins-hbase4.apache.org/34881] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 17:09:02,272 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 17:09:02,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690218542272 (current time:1690218542272). 2023-07-24 17:09:02,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 17:09:02,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(139): Connect 0x3077974c to 127.0.0.1:49884 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:09:02,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2a2ab75a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:09:02,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:09:02,293 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55930, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:09:02,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3077974c to 127.0.0.1:49884 2023-07-24 17:09:02,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:09:02,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(139): Connect 0x4681cac4 to 127.0.0.1:49884 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:09:02,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ac0f8af, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:09:02,313 DEBUG [hconnection-0x35af16ca-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:09:02,316 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55940, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:09:02,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4681cac4 to 127.0.0.1:49884 2023-07-24 17:09:02,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:09:02,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-24 17:09:02,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 17:09:02,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 17:09:02,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 17:09:02,327 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 17:09:02,328 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1690219142328 2023-07-24 17:09:02,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 17:09:02,328 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,329 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 17:09:02,329 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 17:09:02,330 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 17:09:02,331 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 17:09:02,332 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 7 msec 2023-07-24 17:09:02,333 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 17:09:02,333 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1690219142333 2023-07-24 17:09:02,346 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,347 INFO [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-24 17:09:02,347 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:09:02,350 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-24 17:09:02,350 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-24 17:09:02,427 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,427 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,429 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:09:02,429 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:09:02,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:09:02,429 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:09:02,429 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:09:02,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:09:02,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:09:02,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:09:02,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:09:02,429 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:09:02,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:09:02,429 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:09:02,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,430 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:09:02,430 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 17:09:02,430 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:09:02,430 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,430 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,430 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-24 17:09:02,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-24 17:09:02,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,430 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 17:09:02,430 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 17:09:02,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 17:09:02,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-24 17:09:02,431 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,431 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,431 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 17:09:02,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-24 17:09:02,431 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 17:09:02,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,431 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:09:02,431 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 17:09:02,431 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:09:02,432 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 17:09:02,432 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 17:09:02,433 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 17:09:02,433 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 17:09:02,433 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,433 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 17:09:02,434 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 17:09:02,434 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:09:02,433 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37115,1690218390225' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 17:09:02,435 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 17:09:02,435 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 17:09:02,434 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44109,1690218390103' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 17:09:02,435 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43483,1690218390174' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 17:09:02,436 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,436 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:09:02,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:09:02,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:09:02,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:09:02,437 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:09:02,437 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,437 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:09:02,437 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,437 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:09:02,438 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,438 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:09:02,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:09:02,438 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,438 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:09:02,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:09:02,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:09:02,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:09:02,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:09:02,439 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37115,1690218390225' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-24 17:09:02,439 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4623fd43[Count = 1] remaining members to acquire global barrier 2023-07-24 17:09:02,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:09:02,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:09:02,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:09:02,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:09:02,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:09:02,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:09:02,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:09:02,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:09:02,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:09:02,441 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44109,1690218390103' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-24 17:09:02,441 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4623fd43[Count = 0] remaining members to acquire global barrier 2023-07-24 17:09:02,441 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-24 17:09:02,442 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,448 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,448 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,448 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,448 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 17:09:02,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,448 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:09:02,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,449 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 17:09:02,449 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 17:09:02,448 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 17:09:02,449 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690218541283.6a66e336162445896a567a53203d4807. 2023-07-24 17:09:02,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,449 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690218541283.6a66e336162445896a567a53203d4807. started... 2023-07-24 17:09:02,449 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 17:09:02,449 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 17:09:02,449 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:09:02,449 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 17:09:02,449 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 17:09:02,449 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 17:09:02,449 INFO [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6a66e336162445896a567a53203d4807 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-24 17:09:02,449 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43483,1690218390174' in zk 2023-07-24 17:09:02,449 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690218541283.bfc53ec1e98c9301f790bcff7c7c50e0. 2023-07-24 17:09:02,449 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690218541283.bfc53ec1e98c9301f790bcff7c7c50e0. started... 2023-07-24 17:09:02,449 INFO [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] regionserver.HRegion(2745): Flushing bfc53ec1e98c9301f790bcff7c7c50e0 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-24 17:09:02,451 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 17:09:02,451 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:09:02,451 DEBUG [member: 'jenkins-hbase4.apache.org,43483,1690218390174' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 17:09:02,470 INFO [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=333 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithSkipTmp/6a66e336162445896a567a53203d4807/.tmp/cf/b7d8fd1997604343b1a1fb474b62781c 2023-07-24 17:09:02,474 INFO [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.93 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithSkipTmp/bfc53ec1e98c9301f790bcff7c7c50e0/.tmp/cf/59621731a55f4709a2299214652a5ac1 2023-07-24 17:09:02,476 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithSkipTmp/6a66e336162445896a567a53203d4807/.tmp/cf/b7d8fd1997604343b1a1fb474b62781c as hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithSkipTmp/6a66e336162445896a567a53203d4807/cf/b7d8fd1997604343b1a1fb474b62781c 2023-07-24 17:09:02,480 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithSkipTmp/bfc53ec1e98c9301f790bcff7c7c50e0/.tmp/cf/59621731a55f4709a2299214652a5ac1 as hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithSkipTmp/bfc53ec1e98c9301f790bcff7c7c50e0/cf/59621731a55f4709a2299214652a5ac1 2023-07-24 17:09:02,481 INFO [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithSkipTmp/6a66e336162445896a567a53203d4807/cf/b7d8fd1997604343b1a1fb474b62781c, entries=5, sequenceid=6, filesize=5.2 K 2023-07-24 17:09:02,482 INFO [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 6a66e336162445896a567a53203d4807 in 33ms, sequenceid=6, compaction requested=false 2023-07-24 17:09:02,482 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-24 17:09:02,483 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6a66e336162445896a567a53203d4807: 2023-07-24 17:09:02,483 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1690218541283.6a66e336162445896a567a53203d4807.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,483 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 17:09:02,484 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithSkipTmp/6a66e336162445896a567a53203d4807/cf/b7d8fd1997604343b1a1fb474b62781c] hfiles 2023-07-24 17:09:02,484 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithSkipTmp/6a66e336162445896a567a53203d4807/cf/b7d8fd1997604343b1a1fb474b62781c for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,490 INFO [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithSkipTmp/bfc53ec1e98c9301f790bcff7c7c50e0/cf/59621731a55f4709a2299214652a5ac1, entries=45, sequenceid=6, filesize=7.9 K 2023-07-24 17:09:02,491 INFO [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for bfc53ec1e98c9301f790bcff7c7c50e0 in 42ms, sequenceid=6, compaction requested=false 2023-07-24 17:09:02,495 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bfc53ec1e98c9301f790bcff7c7c50e0: 2023-07-24 17:09:02,495 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1690218541283.bfc53ec1e98c9301f790bcff7c7c50e0.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,495 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 17:09:02,495 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithSkipTmp/bfc53ec1e98c9301f790bcff7c7c50e0/cf/59621731a55f4709a2299214652a5ac1] hfiles 2023-07-24 17:09:02,495 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithSkipTmp/bfc53ec1e98c9301f790bcff7c7c50e0/cf/59621731a55f4709a2299214652a5ac1 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,507 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690218541283.6a66e336162445896a567a53203d4807. completed. 2023-07-24 17:09:02,507 DEBUG [rs(jenkins-hbase4.apache.org,37115,1690218390225)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690218541283.6a66e336162445896a567a53203d4807. 2023-07-24 17:09:02,507 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 17:09:02,508 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 17:09:02,508 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:09:02,508 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 17:09:02,508 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37115,1690218390225' in zk 2023-07-24 17:09:02,510 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 17:09:02,510 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:09:02,510 DEBUG [member: 'jenkins-hbase4.apache.org,37115,1690218390225' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 17:09:02,510 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:09:02,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:09:02,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:09:02,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:09:02,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:09:02,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:09:02,515 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690218541283.bfc53ec1e98c9301f790bcff7c7c50e0. completed. 2023-07-24 17:09:02,515 DEBUG [rs(jenkins-hbase4.apache.org,44109,1690218390103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690218541283.bfc53ec1e98c9301f790bcff7c7c50e0. 2023-07-24 17:09:02,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,515 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 17:09:02,515 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 17:09:02,515 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:09:02,515 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 17:09:02,515 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,44109,1690218390103' in zk 2023-07-24 17:09:02,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:09:02,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:09:02,517 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 17:09:02,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:09:02,517 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:09:02,517 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:09:02,517 DEBUG [member: 'jenkins-hbase4.apache.org,44109,1690218390103' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 17:09:02,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:09:02,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:09:02,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:09:02,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:09:02,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,37115,1690218390225': 2023-07-24 17:09:02,521 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37115,1690218390225' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-24 17:09:02,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:09:02,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:09:02,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:09:02,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:09:02,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:09:02,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:09:02,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:09:02,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:09:02,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:09:02,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:09:02,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:09:02,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:09:02,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,44109,1690218390103': 2023-07-24 17:09:02,526 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44109,1690218390103' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-24 17:09:02,526 INFO [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-24 17:09:02,526 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 17:09:02,526 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 17:09:02,526 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,526 INFO [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 17:09:02,530 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,530 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:09:02,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,530 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,530 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,530 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:09:02,530 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,530 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:09:02,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:09:02,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:09:02,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:09:02,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:09:02,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:09:02,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:09:02,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:09:02,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:09:02,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:09:02,533 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:09:02,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,533 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:09:02,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:09:02,534 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:09:02,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:09:02,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:09:02,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:09:02,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:09:02,536 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:09:02,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,536 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:09:02,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:09:02,537 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:09:02,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:09:02,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:09:02,540 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:09:02,540 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:09:02,540 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,540 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:09:02,540 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:09:02,540 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:09:02,540 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:09:02,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:09:02,540 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:09:02,540 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:09:02,540 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,540 DEBUG [(jenkins-hbase4.apache.org,46651,1690218388662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:09:02,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:09:02,540 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:09:02,540 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,542 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:09:02,542 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:09:02,542 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:09:02,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:09:02,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:09:02,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:09:02,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:09:02,542 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:09:02,543 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:09:02,543 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,543 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,543 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:09:02,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:09:02,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:09:02,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:09:02,577 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,606 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-24 17:09:02,606 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,606 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,606 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1690218542328Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1690218542540 (+212 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1690218542541 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1690218542546 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1690218542567 (+21 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1690218542606 (+39 ms) 2023-07-24 17:09:02,610 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 17:09:02,611 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 281 msec 2023-07-24 17:09:02,632 DEBUG [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:09:02,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 17:09:02,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 17:09:02,634 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/export-test/export-1690218542634 2023-07-24 17:09:02,634 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:41733, tgtDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/export-test/export-1690218542634, rawTgtDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/export-test/export-1690218542634, srcFsUri=hdfs://localhost:41733, srcDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d 2023-07-24 17:09:02,656 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:41733, inputRoot=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d 2023-07-24 17:09:02,656 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2025625666_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/export-test/export-1690218542634, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/export-test/export-1690218542634/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:02,656 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:41733, inputRoot=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d, snapshotDir=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-24 17:09:02,663 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/export-test/export-1690218542634/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:03,086 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 17:09:03,086 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 17:09:03,087 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 17:09:03,087 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 17:09:03,088 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-24 17:09:03,088 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 17:09:03,089 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 17:09:03,180 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/hadoop-7503929396070906239.jar 2023-07-24 17:09:03,181 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 17:09:03,182 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 17:09:03,182 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 17:09:03,183 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 17:09:03,183 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 17:09:03,184 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 17:09:03,184 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 17:09:03,185 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 17:09:03,185 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 17:09:03,186 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 17:09:03,187 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 17:09:03,187 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 17:09:03,188 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 17:09:03,188 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 17:09:03,189 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 17:09:03,189 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 17:09:03,190 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 17:09:03,190 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 17:09:03,191 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 17:09:03,191 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 17:09:03,192 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 17:09:03,192 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 17:09:03,193 DEBUG [Listener at jenkins-hbase4.apache.org/34881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 17:09:03,886 WARN [Listener at jenkins-hbase4.apache.org/34881] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 17:09:03,889 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-24 17:09:03,891 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-24 17:09:05,683 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 17:09:05,683 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 17:09:05,690 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397910_0006_000001 (auth:SIMPLE) 2023-07-24 17:09:06,009 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397910_0007_000001 (auth:SIMPLE) 2023-07-24 17:09:06,685 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 17:09:11,741 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397910_0007_000001 (auth:SIMPLE) 2023-07-24 17:09:14,004 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397910_0007_000001 (auth:SIMPLE) 2023-07-24 17:09:17,235 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397910_0007_000001 (auth:SIMPLE) 2023-07-24 17:09:19,152 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 17:09:19,152 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 17:09:19,176 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:19,176 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 17:09:19,176 INFO [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 17:09:19,177 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-789691247_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:19,177 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(367): hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-24 17:09:19,177 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(367): hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-24 17:09:19,177 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-789691247_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/export-test/export-1690218542634/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/export-test/export-1690218542634/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:19,178 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(367): hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/export-test/export-1690218542634/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-24 17:09:19,178 DEBUG [Listener at jenkins-hbase4.apache.org/34881] snapshot.TestExportSnapshot(367): hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/export-test/export-1690218542634/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-24 17:09:19,191 INFO [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:19,192 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:19,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:19,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-24 17:09:19,197 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218559197"}]},"ts":"1690218559197"} 2023-07-24 17:09:19,199 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-24 17:09:19,201 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-24 17:09:19,202 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6a66e336162445896a567a53203d4807, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=bfc53ec1e98c9301f790bcff7c7c50e0, UNASSIGN}] 2023-07-24 17:09:19,202 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6a66e336162445896a567a53203d4807, UNASSIGN 2023-07-24 17:09:19,204 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=bfc53ec1e98c9301f790bcff7c7c50e0, UNASSIGN 2023-07-24 17:09:19,205 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=6a66e336162445896a567a53203d4807, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:09:19,205 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690218541283.6a66e336162445896a567a53203d4807.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690218559205"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218559205"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218559205"}]},"ts":"1690218559205"} 2023-07-24 17:09:19,206 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=bfc53ec1e98c9301f790bcff7c7c50e0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:09:19,206 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690218541283.bfc53ec1e98c9301f790bcff7c7c50e0.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690218559206"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218559206"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218559206"}]},"ts":"1690218559206"} 2023-07-24 17:09:19,207 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 6a66e336162445896a567a53203d4807, server=jenkins-hbase4.apache.org,37115,1690218390225}] 2023-07-24 17:09:19,210 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure bfc53ec1e98c9301f790bcff7c7c50e0, server=jenkins-hbase4.apache.org,44109,1690218390103}] 2023-07-24 17:09:19,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-24 17:09:19,360 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6a66e336162445896a567a53203d4807 2023-07-24 17:09:19,360 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6a66e336162445896a567a53203d4807, disabling compactions & flushes 2023-07-24 17:09:19,361 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1690218541283.6a66e336162445896a567a53203d4807. 2023-07-24 17:09:19,361 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690218541283.6a66e336162445896a567a53203d4807. 2023-07-24 17:09:19,361 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690218541283.6a66e336162445896a567a53203d4807. after waiting 0 ms 2023-07-24 17:09:19,361 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1690218541283.6a66e336162445896a567a53203d4807. 2023-07-24 17:09:19,363 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close bfc53ec1e98c9301f790bcff7c7c50e0 2023-07-24 17:09:19,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing bfc53ec1e98c9301f790bcff7c7c50e0, disabling compactions & flushes 2023-07-24 17:09:19,364 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1690218541283.bfc53ec1e98c9301f790bcff7c7c50e0. 2023-07-24 17:09:19,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690218541283.bfc53ec1e98c9301f790bcff7c7c50e0. 2023-07-24 17:09:19,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690218541283.bfc53ec1e98c9301f790bcff7c7c50e0. after waiting 0 ms 2023-07-24 17:09:19,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1690218541283.bfc53ec1e98c9301f790bcff7c7c50e0. 2023-07-24 17:09:19,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithSkipTmp/6a66e336162445896a567a53203d4807/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 17:09:19,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/default/testtb-testExportFileSystemStateWithSkipTmp/bfc53ec1e98c9301f790bcff7c7c50e0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 17:09:19,385 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 17:09:19,387 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 17:09:19,388 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1690218541283.6a66e336162445896a567a53203d4807. 2023-07-24 17:09:19,388 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1690218541283.bfc53ec1e98c9301f790bcff7c7c50e0. 2023-07-24 17:09:19,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6a66e336162445896a567a53203d4807: 2023-07-24 17:09:19,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for bfc53ec1e98c9301f790bcff7c7c50e0: 2023-07-24 17:09:19,390 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed bfc53ec1e98c9301f790bcff7c7c50e0 2023-07-24 17:09:19,391 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=bfc53ec1e98c9301f790bcff7c7c50e0, regionState=CLOSED 2023-07-24 17:09:19,391 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690218541283.bfc53ec1e98c9301f790bcff7c7c50e0.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690218559391"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218559391"}]},"ts":"1690218559391"} 2023-07-24 17:09:19,394 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6a66e336162445896a567a53203d4807 2023-07-24 17:09:19,395 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=6a66e336162445896a567a53203d4807, regionState=CLOSED 2023-07-24 17:09:19,395 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690218541283.6a66e336162445896a567a53203d4807.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690218559395"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218559395"}]},"ts":"1690218559395"} 2023-07-24 17:09:19,398 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-24 17:09:19,398 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure bfc53ec1e98c9301f790bcff7c7c50e0, server=jenkins-hbase4.apache.org,44109,1690218390103 in 186 msec 2023-07-24 17:09:19,399 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-24 17:09:19,399 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 6a66e336162445896a567a53203d4807, server=jenkins-hbase4.apache.org,37115,1690218390225 in 190 msec 2023-07-24 17:09:19,400 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=bfc53ec1e98c9301f790bcff7c7c50e0, UNASSIGN in 196 msec 2023-07-24 17:09:19,401 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=115, resume processing ppid=114 2023-07-24 17:09:19,401 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6a66e336162445896a567a53203d4807, UNASSIGN in 197 msec 2023-07-24 17:09:19,401 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218559401"}]},"ts":"1690218559401"} 2023-07-24 17:09:19,402 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-24 17:09:19,404 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-24 17:09:19,406 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 213 msec 2023-07-24 17:09:19,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-24 17:09:19,499 INFO [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-24 17:09:19,500 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:19,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:19,503 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:19,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:19,504 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:19,505 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37115] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:19,510 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:19,510 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:19,511 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-24 17:09:19,511 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-24 17:09:19,511 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:19,511 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:19,512 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:19,513 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:09:19,513 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-07-24 17:09:19,513 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 17:09:19,513 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:19,513 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:09:19,513 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:09:19,513 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:09:19,513 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-07-24 17:09:19,514 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 17:09:19,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-24 17:09:19,519 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6a66e336162445896a567a53203d4807 2023-07-24 17:09:19,519 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bfc53ec1e98c9301f790bcff7c7c50e0 2023-07-24 17:09:19,521 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6a66e336162445896a567a53203d4807/cf, FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6a66e336162445896a567a53203d4807/recovered.edits] 2023-07-24 17:09:19,521 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bfc53ec1e98c9301f790bcff7c7c50e0/cf, FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bfc53ec1e98c9301f790bcff7c7c50e0/recovered.edits] 2023-07-24 17:09:19,525 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6a66e336162445896a567a53203d4807/cf/b7d8fd1997604343b1a1fb474b62781c to hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/6a66e336162445896a567a53203d4807/cf/b7d8fd1997604343b1a1fb474b62781c 2023-07-24 17:09:19,525 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bfc53ec1e98c9301f790bcff7c7c50e0/cf/59621731a55f4709a2299214652a5ac1 to hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/bfc53ec1e98c9301f790bcff7c7c50e0/cf/59621731a55f4709a2299214652a5ac1 2023-07-24 17:09:19,529 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6a66e336162445896a567a53203d4807/recovered.edits/9.seqid to hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/6a66e336162445896a567a53203d4807/recovered.edits/9.seqid 2023-07-24 17:09:19,529 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bfc53ec1e98c9301f790bcff7c7c50e0/recovered.edits/9.seqid to hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/bfc53ec1e98c9301f790bcff7c7c50e0/recovered.edits/9.seqid 2023-07-24 17:09:19,530 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6a66e336162445896a567a53203d4807 2023-07-24 17:09:19,530 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bfc53ec1e98c9301f790bcff7c7c50e0 2023-07-24 17:09:19,530 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-24 17:09:19,532 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:19,534 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-24 17:09:19,543 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-24 17:09:19,544 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:19,544 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-24 17:09:19,544 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690218541283.6a66e336162445896a567a53203d4807.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690218559544"}]},"ts":"9223372036854775807"} 2023-07-24 17:09:19,545 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690218541283.bfc53ec1e98c9301f790bcff7c7c50e0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690218559544"}]},"ts":"9223372036854775807"} 2023-07-24 17:09:19,551 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 17:09:19,551 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6a66e336162445896a567a53203d4807, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690218541283.6a66e336162445896a567a53203d4807.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => bfc53ec1e98c9301f790bcff7c7c50e0, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690218541283.bfc53ec1e98c9301f790bcff7c7c50e0.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 17:09:19,552 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-24 17:09:19,552 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690218559552"}]},"ts":"9223372036854775807"} 2023-07-24 17:09:19,555 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-24 17:09:19,563 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:19,566 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 63 msec 2023-07-24 17:09:19,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-24 17:09:19,616 INFO [Listener at jenkins-hbase4.apache.org/34881] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-24 17:09:19,623 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-24 17:09:19,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:19,626 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-24 17:09:19,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46651] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:19,657 INFO [Listener at jenkins-hbase4.apache.org/34881] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=766 (was 766), OpenFileDescriptor=902 (was 916), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=667 (was 637) - SystemLoadAverage LEAK? -, ProcessCount=186 (was 185) - ProcessCount LEAK? -, AvailableMemoryMB=3837 (was 3974) 2023-07-24 17:09:19,657 WARN [Listener at jenkins-hbase4.apache.org/34881] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-07-24 17:09:19,657 INFO [Listener at jenkins-hbase4.apache.org/34881] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-24 17:09:19,673 INFO [Listener at jenkins-hbase4.apache.org/34881] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-24 17:09:19,692 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1690218397910_0007_01_000001 is : 143 2023-07-24 17:09:24,964 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 17:09:33,704 INFO [Listener at jenkins-hbase4.apache.org/34881] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-24 17:09:47,827 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-24 17:09:47,828 INFO [Listener at jenkins-hbase4.apache.org/34881] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-24 17:09:47,946 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-24 17:09:47,959 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-24 17:09:47,960 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-24 17:09:47,987 INFO [Listener at jenkins-hbase4.apache.org/34881] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-24 17:09:48,091 ERROR [Thread[Thread-385,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-24 17:09:48,091 INFO [Listener at jenkins-hbase4.apache.org/34881] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-24 17:09:48,091 INFO [Listener at jenkins-hbase4.apache.org/34881] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-24 17:09:48,091 INFO [Listener at jenkins-hbase4.apache.org/34881] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-24 17:09:48,091 DEBUG [Listener at jenkins-hbase4.apache.org/34881] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x695cdb1e to 127.0.0.1:49884 2023-07-24 17:09:48,092 DEBUG [Listener at jenkins-hbase4.apache.org/34881] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:09:48,092 DEBUG [Listener at jenkins-hbase4.apache.org/34881] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-24 17:09:48,093 DEBUG [Listener at jenkins-hbase4.apache.org/34881] util.JVMClusterUtil(257): Found active master hash=1872571225, stopped=false 2023-07-24 17:09:48,093 DEBUG [Listener at jenkins-hbase4.apache.org/34881] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 17:09:48,093 DEBUG [Listener at jenkins-hbase4.apache.org/34881] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-24 17:09:48,093 INFO [Listener at jenkins-hbase4.apache.org/34881] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,46651,1690218388662 2023-07-24 17:09:48,094 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-24 17:09:48,095 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-24 17:09:48,095 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-24 17:09:48,095 INFO [Listener at jenkins-hbase4.apache.org/34881] procedure2.ProcedureExecutor(629): Stopping 2023-07-24 17:09:48,095 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-24 17:09:48,095 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 17:09:48,095 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 17:09:48,095 DEBUG [Listener at jenkins-hbase4.apache.org/34881] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7235e2fd to 127.0.0.1:49884 2023-07-24 17:09:48,095 DEBUG [Listener at jenkins-hbase4.apache.org/34881] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:09:48,095 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 17:09:48,095 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 17:09:48,095 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 17:09:48,097 INFO [RS:2;jenkins-hbase4:37115] regionserver.HRegionServer(1064): Closing user regions 2023-07-24 17:09:48,097 INFO [Listener at jenkins-hbase4.apache.org/34881] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,44109,1690218390103' ***** 2023-07-24 17:09:48,097 DEBUG [Listener at jenkins-hbase4.apache.org/34881] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 17:09:48,097 INFO [RS:2;jenkins-hbase4:37115] regionserver.HRegionServer(3305): Received CLOSE for 8e0ac9376dc85844660fd8309fd71da7 2023-07-24 17:09:48,097 INFO [Listener at jenkins-hbase4.apache.org/34881] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-24 17:09:48,097 INFO [Listener at jenkins-hbase4.apache.org/34881] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,43483,1690218390174' ***** 2023-07-24 17:09:48,098 DEBUG [Listener at jenkins-hbase4.apache.org/34881] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 17:09:48,098 INFO [Listener at jenkins-hbase4.apache.org/34881] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-24 17:09:48,098 INFO [RS:0;jenkins-hbase4:44109] regionserver.HeapMemoryManager(220): Stopping 2023-07-24 17:09:48,098 INFO [Listener at jenkins-hbase4.apache.org/34881] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,37115,1690218390225' ***** 2023-07-24 17:09:48,098 DEBUG [Listener at jenkins-hbase4.apache.org/34881] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 17:09:48,098 INFO [Listener at jenkins-hbase4.apache.org/34881] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-24 17:09:48,098 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-24 17:09:48,098 INFO [RS:0;jenkins-hbase4:44109] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-24 17:09:48,099 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8e0ac9376dc85844660fd8309fd71da7, disabling compactions & flushes 2023-07-24 17:09:48,098 INFO [RS:1;jenkins-hbase4:43483] regionserver.HeapMemoryManager(220): Stopping 2023-07-24 17:09:48,099 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1690218393900.8e0ac9376dc85844660fd8309fd71da7. 2023-07-24 17:09:48,099 INFO [RS:1;jenkins-hbase4:43483] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-24 17:09:48,099 INFO [RS:0;jenkins-hbase4:44109] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-24 17:09:48,099 INFO [RS:1;jenkins-hbase4:43483] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-24 17:09:48,099 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1690218393900.8e0ac9376dc85844660fd8309fd71da7. 2023-07-24 17:09:48,099 INFO [RS:0;jenkins-hbase4:44109] regionserver.HRegionServer(3305): Received CLOSE for d9f6676dfabf50c523bb1e34a000aec8 2023-07-24 17:09:48,099 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-24 17:09:48,099 INFO [RS:0;jenkins-hbase4:44109] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:09:48,100 DEBUG [RS:0;jenkins-hbase4:44109] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0fb38203 to 127.0.0.1:49884 2023-07-24 17:09:48,099 INFO [RS:2;jenkins-hbase4:37115] regionserver.HeapMemoryManager(220): Stopping 2023-07-24 17:09:48,099 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1690218393900.8e0ac9376dc85844660fd8309fd71da7. after waiting 0 ms 2023-07-24 17:09:48,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d9f6676dfabf50c523bb1e34a000aec8, disabling compactions & flushes 2023-07-24 17:09:48,099 INFO [RS:1;jenkins-hbase4:43483] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:09:48,101 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690218393017.d9f6676dfabf50c523bb1e34a000aec8. 2023-07-24 17:09:48,101 DEBUG [RS:1;jenkins-hbase4:43483] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4936c287 to 127.0.0.1:49884 2023-07-24 17:09:48,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1690218393900.8e0ac9376dc85844660fd8309fd71da7. 2023-07-24 17:09:48,100 INFO [RS:2;jenkins-hbase4:37115] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-24 17:09:48,100 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-24 17:09:48,100 DEBUG [RS:0;jenkins-hbase4:44109] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:09:48,101 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 8e0ac9376dc85844660fd8309fd71da7 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-24 17:09:48,101 INFO [RS:2;jenkins-hbase4:37115] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-24 17:09:48,101 DEBUG [RS:1;jenkins-hbase4:43483] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:09:48,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690218393017.d9f6676dfabf50c523bb1e34a000aec8. 2023-07-24 17:09:48,105 INFO [RS:1;jenkins-hbase4:43483] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,43483,1690218390174; all regions closed. 2023-07-24 17:09:48,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690218393017.d9f6676dfabf50c523bb1e34a000aec8. after waiting 0 ms 2023-07-24 17:09:48,102 INFO [RS:2;jenkins-hbase4:37115] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:09:48,102 INFO [RS:0;jenkins-hbase4:44109] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-24 17:09:48,105 DEBUG [RS:2;jenkins-hbase4:37115] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x76486012 to 127.0.0.1:49884 2023-07-24 17:09:48,105 DEBUG [RS:0;jenkins-hbase4:44109] regionserver.HRegionServer(1478): Online Regions={d9f6676dfabf50c523bb1e34a000aec8=hbase:namespace,,1690218393017.d9f6676dfabf50c523bb1e34a000aec8.} 2023-07-24 17:09:48,106 DEBUG [RS:0;jenkins-hbase4:44109] regionserver.HRegionServer(1504): Waiting on d9f6676dfabf50c523bb1e34a000aec8 2023-07-24 17:09:48,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690218393017.d9f6676dfabf50c523bb1e34a000aec8. 2023-07-24 17:09:48,105 DEBUG [RS:2;jenkins-hbase4:37115] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:09:48,106 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing d9f6676dfabf50c523bb1e34a000aec8 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-24 17:09:48,109 INFO [RS:2;jenkins-hbase4:37115] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-24 17:09:48,109 INFO [RS:2;jenkins-hbase4:37115] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-24 17:09:48,109 INFO [RS:2;jenkins-hbase4:37115] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-24 17:09:48,109 INFO [RS:2;jenkins-hbase4:37115] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-24 17:09:48,115 INFO [RS:2;jenkins-hbase4:37115] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-24 17:09:48,115 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-24 17:09:48,117 DEBUG [RS:2;jenkins-hbase4:37115] regionserver.HRegionServer(1478): Online Regions={8e0ac9376dc85844660fd8309fd71da7=hbase:acl,,1690218393900.8e0ac9376dc85844660fd8309fd71da7., 1588230740=hbase:meta,,1.1588230740} 2023-07-24 17:09:48,118 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-24 17:09:48,118 DEBUG [RS:2;jenkins-hbase4:37115] regionserver.HRegionServer(1504): Waiting on 1588230740, 8e0ac9376dc85844660fd8309fd71da7 2023-07-24 17:09:48,118 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-24 17:09:48,118 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-24 17:09:48,118 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-24 17:09:48,118 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-24 17:09:48,118 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-24 17:09:48,143 DEBUG [RS:1;jenkins-hbase4:43483] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/oldWALs 2023-07-24 17:09:48,143 INFO [RS:1;jenkins-hbase4:43483] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43483%2C1690218390174:(num 1690218392419) 2023-07-24 17:09:48,143 DEBUG [RS:1;jenkins-hbase4:43483] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:09:48,143 INFO [RS:1;jenkins-hbase4:43483] regionserver.LeaseManager(133): Closed leases 2023-07-24 17:09:48,143 INFO [RS:1;jenkins-hbase4:43483] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-24 17:09:48,144 INFO [RS:1;jenkins-hbase4:43483] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-24 17:09:48,144 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-24 17:09:48,144 INFO [RS:1;jenkins-hbase4:43483] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-24 17:09:48,144 INFO [RS:1;jenkins-hbase4:43483] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-24 17:09:48,162 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-24 17:09:48,167 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/hbase/namespace/d9f6676dfabf50c523bb1e34a000aec8/.tmp/info/e298746cdc8c412bbae08184946c947a 2023-07-24 17:09:48,174 INFO [RS:1;jenkins-hbase4:43483] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43483 2023-07-24 17:09:48,184 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/hbase/acl/8e0ac9376dc85844660fd8309fd71da7/.tmp/l/8da45e8a98784df9ab304610d9be1531 2023-07-24 17:09:48,185 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:09:48,185 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:09:48,186 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43483,1690218390174 2023-07-24 17:09:48,186 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 17:09:48,185 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 17:09:48,186 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 17:09:48,186 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 17:09:48,191 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43483,1690218390174] 2023-07-24 17:09:48,193 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-24 17:09:48,204 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8da45e8a98784df9ab304610d9be1531 2023-07-24 17:09:48,207 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/hbase/acl/8e0ac9376dc85844660fd8309fd71da7/.tmp/l/8da45e8a98784df9ab304610d9be1531 as hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/hbase/acl/8e0ac9376dc85844660fd8309fd71da7/l/8da45e8a98784df9ab304610d9be1531 2023-07-24 17:09:48,210 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/hbase/meta/1588230740/.tmp/info/cc4e61590b2e40398843b306145abfa2 2023-07-24 17:09:48,213 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43483,1690218390174; numProcessing=1 2023-07-24 17:09:48,216 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43483,1690218390174 already deleted, retry=false 2023-07-24 17:09:48,216 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43483,1690218390174 expired; onlineServers=2 2023-07-24 17:09:48,216 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8da45e8a98784df9ab304610d9be1531 2023-07-24 17:09:48,216 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/hbase/acl/8e0ac9376dc85844660fd8309fd71da7/l/8da45e8a98784df9ab304610d9be1531, entries=7, sequenceid=18, filesize=5.2 K 2023-07-24 17:09:48,216 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/hbase/namespace/d9f6676dfabf50c523bb1e34a000aec8/.tmp/info/e298746cdc8c412bbae08184946c947a as hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/hbase/namespace/d9f6676dfabf50c523bb1e34a000aec8/info/e298746cdc8c412bbae08184946c947a 2023-07-24 17:09:48,217 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 8e0ac9376dc85844660fd8309fd71da7 in 116ms, sequenceid=18, compaction requested=false 2023-07-24 17:09:48,221 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-24 17:09:48,221 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-24 17:09:48,230 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cc4e61590b2e40398843b306145abfa2 2023-07-24 17:09:48,247 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-24 17:09:48,248 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-24 17:09:48,250 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/hbase/namespace/d9f6676dfabf50c523bb1e34a000aec8/info/e298746cdc8c412bbae08184946c947a, entries=2, sequenceid=6, filesize=4.8 K 2023-07-24 17:09:48,253 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for d9f6676dfabf50c523bb1e34a000aec8 in 147ms, sequenceid=6, compaction requested=false 2023-07-24 17:09:48,313 DEBUG [RS:0;jenkins-hbase4:44109] regionserver.HRegionServer(1504): Waiting on d9f6676dfabf50c523bb1e34a000aec8 2023-07-24 17:09:48,313 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/hbase/acl/8e0ac9376dc85844660fd8309fd71da7/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-24 17:09:48,314 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 17:09:48,315 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 17:09:48,315 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:43483-0x101984c5c040002, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 17:09:48,315 INFO [RS:1;jenkins-hbase4:43483] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,43483,1690218390174; zookeeper connection closed. 2023-07-24 17:09:48,318 DEBUG [RS:2;jenkins-hbase4:37115] regionserver.HRegionServer(1504): Waiting on 1588230740, 8e0ac9376dc85844660fd8309fd71da7 2023-07-24 17:09:48,328 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1690218393900.8e0ac9376dc85844660fd8309fd71da7. 2023-07-24 17:09:48,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8e0ac9376dc85844660fd8309fd71da7: 2023-07-24 17:09:48,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1690218393900.8e0ac9376dc85844660fd8309fd71da7. 2023-07-24 17:09:48,329 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/hbase/meta/1588230740/.tmp/rep_barrier/1d34486052d04d7f8d53f05270e2fbed 2023-07-24 17:09:48,330 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/hbase/namespace/d9f6676dfabf50c523bb1e34a000aec8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 17:09:48,331 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@46c20e5e] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@46c20e5e 2023-07-24 17:09:48,332 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 17:09:48,333 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690218393017.d9f6676dfabf50c523bb1e34a000aec8. 2023-07-24 17:09:48,333 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d9f6676dfabf50c523bb1e34a000aec8: 2023-07-24 17:09:48,333 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1690218393017.d9f6676dfabf50c523bb1e34a000aec8. 2023-07-24 17:09:48,337 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1d34486052d04d7f8d53f05270e2fbed 2023-07-24 17:09:48,370 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/hbase/meta/1588230740/.tmp/table/13be7251dd1b4b0395bc3588e190f264 2023-07-24 17:09:48,374 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 13be7251dd1b4b0395bc3588e190f264 2023-07-24 17:09:48,375 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/hbase/meta/1588230740/.tmp/info/cc4e61590b2e40398843b306145abfa2 as hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/hbase/meta/1588230740/info/cc4e61590b2e40398843b306145abfa2 2023-07-24 17:09:48,381 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cc4e61590b2e40398843b306145abfa2 2023-07-24 17:09:48,381 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/hbase/meta/1588230740/info/cc4e61590b2e40398843b306145abfa2, entries=48, sequenceid=131, filesize=10.3 K 2023-07-24 17:09:48,382 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/hbase/meta/1588230740/.tmp/rep_barrier/1d34486052d04d7f8d53f05270e2fbed as hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/hbase/meta/1588230740/rep_barrier/1d34486052d04d7f8d53f05270e2fbed 2023-07-24 17:09:48,388 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1d34486052d04d7f8d53f05270e2fbed 2023-07-24 17:09:48,389 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/hbase/meta/1588230740/rep_barrier/1d34486052d04d7f8d53f05270e2fbed, entries=13, sequenceid=131, filesize=6.4 K 2023-07-24 17:09:48,389 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/hbase/meta/1588230740/.tmp/table/13be7251dd1b4b0395bc3588e190f264 as hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/hbase/meta/1588230740/table/13be7251dd1b4b0395bc3588e190f264 2023-07-24 17:09:48,400 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 13be7251dd1b4b0395bc3588e190f264 2023-07-24 17:09:48,401 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/hbase/meta/1588230740/table/13be7251dd1b4b0395bc3588e190f264, entries=24, sequenceid=131, filesize=6.9 K 2023-07-24 17:09:48,402 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 284ms, sequenceid=131, compaction requested=false 2023-07-24 17:09:48,419 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-24 17:09:48,420 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 17:09:48,420 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-24 17:09:48,421 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-24 17:09:48,421 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-24 17:09:48,422 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-24 17:09:48,513 INFO [RS:0;jenkins-hbase4:44109] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,44109,1690218390103; all regions closed. 2023-07-24 17:09:48,518 INFO [RS:2;jenkins-hbase4:37115] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,37115,1690218390225; all regions closed. 2023-07-24 17:09:48,524 DEBUG [RS:0;jenkins-hbase4:44109] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/oldWALs 2023-07-24 17:09:48,524 INFO [RS:0;jenkins-hbase4:44109] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44109%2C1690218390103:(num 1690218392417) 2023-07-24 17:09:48,525 DEBUG [RS:0;jenkins-hbase4:44109] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:09:48,526 INFO [RS:0;jenkins-hbase4:44109] regionserver.LeaseManager(133): Closed leases 2023-07-24 17:09:48,527 INFO [RS:0;jenkins-hbase4:44109] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-24 17:09:48,528 INFO [RS:0;jenkins-hbase4:44109] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-24 17:09:48,528 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-24 17:09:48,528 INFO [RS:0;jenkins-hbase4:44109] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-24 17:09:48,528 INFO [RS:0;jenkins-hbase4:44109] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-24 17:09:48,529 INFO [RS:0;jenkins-hbase4:44109] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44109 2023-07-24 17:09:48,536 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 17:09:48,536 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:09:48,536 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44109,1690218390103 2023-07-24 17:09:48,538 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44109,1690218390103] 2023-07-24 17:09:48,538 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44109,1690218390103; numProcessing=2 2023-07-24 17:09:48,539 DEBUG [RS:2;jenkins-hbase4:37115] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/oldWALs 2023-07-24 17:09:48,539 INFO [RS:2;jenkins-hbase4:37115] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37115%2C1690218390225.meta:.meta(num 1690218392639) 2023-07-24 17:09:48,539 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44109,1690218390103 already deleted, retry=false 2023-07-24 17:09:48,539 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44109,1690218390103 expired; onlineServers=1 2023-07-24 17:09:48,548 DEBUG [RS:2;jenkins-hbase4:37115] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/oldWALs 2023-07-24 17:09:48,548 INFO [RS:2;jenkins-hbase4:37115] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37115%2C1690218390225:(num 1690218392415) 2023-07-24 17:09:48,549 DEBUG [RS:2;jenkins-hbase4:37115] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:09:48,549 INFO [RS:2;jenkins-hbase4:37115] regionserver.LeaseManager(133): Closed leases 2023-07-24 17:09:48,549 INFO [RS:2;jenkins-hbase4:37115] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-24 17:09:48,549 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-24 17:09:48,550 INFO [RS:2;jenkins-hbase4:37115] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37115 2023-07-24 17:09:48,552 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37115,1690218390225 2023-07-24 17:09:48,552 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 17:09:48,554 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37115,1690218390225] 2023-07-24 17:09:48,554 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37115,1690218390225; numProcessing=3 2023-07-24 17:09:48,555 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37115,1690218390225 already deleted, retry=false 2023-07-24 17:09:48,555 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37115,1690218390225 expired; onlineServers=0 2023-07-24 17:09:48,555 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,46651,1690218388662' ***** 2023-07-24 17:09:48,555 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-24 17:09:48,556 DEBUG [M:0;jenkins-hbase4:46651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2ea02162, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-24 17:09:48,556 INFO [M:0;jenkins-hbase4:46651] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,46651,1690218388662 2023-07-24 17:09:48,556 INFO [M:0;jenkins-hbase4:46651] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,46651,1690218388662; all regions closed. 2023-07-24 17:09:48,556 DEBUG [M:0;jenkins-hbase4:46651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:09:48,556 DEBUG [M:0;jenkins-hbase4:46651] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-24 17:09:48,556 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-24 17:09:48,556 DEBUG [M:0;jenkins-hbase4:46651] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-24 17:09:48,556 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690218391934] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690218391934,5,FailOnTimeoutGroup] 2023-07-24 17:09:48,556 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690218391935] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690218391935,5,FailOnTimeoutGroup] 2023-07-24 17:09:48,556 INFO [M:0;jenkins-hbase4:46651] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-24 17:09:48,556 INFO [M:0;jenkins-hbase4:46651] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-24 17:09:48,556 INFO [M:0;jenkins-hbase4:46651] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-24 17:09:48,557 DEBUG [M:0;jenkins-hbase4:46651] master.HMaster(1512): Stopping service threads 2023-07-24 17:09:48,557 INFO [M:0;jenkins-hbase4:46651] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-24 17:09:48,557 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-24 17:09:48,557 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 17:09:48,557 ERROR [M:0;jenkins-hbase4:46651] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-24 17:09:48,557 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 17:09:48,558 INFO [M:0;jenkins-hbase4:46651] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-24 17:09:48,558 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-24 17:09:48,558 DEBUG [M:0;jenkins-hbase4:46651] zookeeper.ZKUtil(398): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-24 17:09:48,558 WARN [M:0;jenkins-hbase4:46651] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-24 17:09:48,558 INFO [M:0;jenkins-hbase4:46651] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-24 17:09:48,558 INFO [M:0;jenkins-hbase4:46651] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-24 17:09:48,559 DEBUG [M:0;jenkins-hbase4:46651] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-24 17:09:48,559 INFO [M:0;jenkins-hbase4:46651] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 17:09:48,559 DEBUG [M:0;jenkins-hbase4:46651] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 17:09:48,559 DEBUG [M:0;jenkins-hbase4:46651] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-24 17:09:48,559 DEBUG [M:0;jenkins-hbase4:46651] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 17:09:48,559 INFO [M:0;jenkins-hbase4:46651] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=373.33 KB heapSize=449.56 KB 2023-07-24 17:09:48,578 INFO [M:0;jenkins-hbase4:46651] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=373.33 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/973af2d615c541c18d20ecd37aceb376 2023-07-24 17:09:48,584 INFO [M:0;jenkins-hbase4:46651] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 973af2d615c541c18d20ecd37aceb376 2023-07-24 17:09:48,585 DEBUG [M:0;jenkins-hbase4:46651] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/973af2d615c541c18d20ecd37aceb376 as hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/973af2d615c541c18d20ecd37aceb376 2023-07-24 17:09:48,589 INFO [M:0;jenkins-hbase4:46651] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 973af2d615c541c18d20ecd37aceb376 2023-07-24 17:09:48,589 INFO [M:0;jenkins-hbase4:46651] regionserver.HStore(1080): Added hdfs://localhost:41733/user/jenkins/test-data/0fb04ed3-e799-28b4-9afa-05cbd04f460d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/973af2d615c541c18d20ecd37aceb376, entries=119, sequenceid=899, filesize=28.4 K 2023-07-24 17:09:48,590 INFO [M:0;jenkins-hbase4:46651] regionserver.HRegion(2948): Finished flush of dataSize ~373.33 KB/382285, heapSize ~449.55 KB/460336, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 31ms, sequenceid=899, compaction requested=false 2023-07-24 17:09:48,592 INFO [M:0;jenkins-hbase4:46651] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 17:09:48,592 DEBUG [M:0;jenkins-hbase4:46651] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-24 17:09:48,597 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-24 17:09:48,597 INFO [M:0;jenkins-hbase4:46651] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-24 17:09:48,598 INFO [M:0;jenkins-hbase4:46651] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46651 2023-07-24 17:09:48,600 DEBUG [M:0;jenkins-hbase4:46651] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,46651,1690218388662 already deleted, retry=false 2023-07-24 17:09:48,638 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 17:09:48,639 INFO [RS:0;jenkins-hbase4:44109] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,44109,1690218390103; zookeeper connection closed. 2023-07-24 17:09:48,639 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:44109-0x101984c5c040001, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 17:09:48,639 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@244c27] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@244c27 2023-07-24 17:09:48,739 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 17:09:48,739 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): master:46651-0x101984c5c040000, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 17:09:48,739 INFO [M:0;jenkins-hbase4:46651] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,46651,1690218388662; zookeeper connection closed. 2023-07-24 17:09:48,831 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 17:09:48,832 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-24 17:09:48,832 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 17:09:48,832 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-24 17:09:48,832 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 17:09:48,839 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 17:09:48,839 INFO [RS:2;jenkins-hbase4:37115] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,37115,1690218390225; zookeeper connection closed. 2023-07-24 17:09:48,839 DEBUG [Listener at localhost/37397-EventThread] zookeeper.ZKWatcher(600): regionserver:37115-0x101984c5c040003, quorum=127.0.0.1:49884, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 17:09:48,839 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@261017a0] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@261017a0 2023-07-24 17:09:48,840 INFO [Listener at jenkins-hbase4.apache.org/34881] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-24 17:09:48,840 WARN [Listener at jenkins-hbase4.apache.org/34881] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-24 17:09:48,844 INFO [Listener at jenkins-hbase4.apache.org/34881] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-24 17:09:48,949 WARN [BP-352972785-172.31.14.131-1690218384659 heartbeating to localhost/127.0.0.1:41733] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-24 17:09:48,949 WARN [BP-352972785-172.31.14.131-1690218384659 heartbeating to localhost/127.0.0.1:41733] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-352972785-172.31.14.131-1690218384659 (Datanode Uuid 8276aedc-77c7-41a6-8382-f0e0b3cbb28d) service to localhost/127.0.0.1:41733 2023-07-24 17:09:48,951 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/cluster_4cc708a3-96e2-4835-db32-d049ee6d4ce3/dfs/data/data5/current/BP-352972785-172.31.14.131-1690218384659] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 17:09:48,951 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/cluster_4cc708a3-96e2-4835-db32-d049ee6d4ce3/dfs/data/data6/current/BP-352972785-172.31.14.131-1690218384659] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 17:09:48,953 WARN [Listener at jenkins-hbase4.apache.org/34881] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-24 17:09:48,966 INFO [Listener at jenkins-hbase4.apache.org/34881] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-24 17:09:48,971 WARN [BP-352972785-172.31.14.131-1690218384659 heartbeating to localhost/127.0.0.1:41733] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-24 17:09:48,971 WARN [BP-352972785-172.31.14.131-1690218384659 heartbeating to localhost/127.0.0.1:41733] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-352972785-172.31.14.131-1690218384659 (Datanode Uuid 969d041e-e829-4e9d-b5f7-e68f89910049) service to localhost/127.0.0.1:41733 2023-07-24 17:09:48,972 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/cluster_4cc708a3-96e2-4835-db32-d049ee6d4ce3/dfs/data/data3/current/BP-352972785-172.31.14.131-1690218384659] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 17:09:48,973 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/cluster_4cc708a3-96e2-4835-db32-d049ee6d4ce3/dfs/data/data4/current/BP-352972785-172.31.14.131-1690218384659] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 17:09:48,974 WARN [Listener at jenkins-hbase4.apache.org/34881] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-24 17:09:49,007 INFO [Listener at jenkins-hbase4.apache.org/34881] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-24 17:09:49,111 WARN [BP-352972785-172.31.14.131-1690218384659 heartbeating to localhost/127.0.0.1:41733] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-24 17:09:49,111 WARN [BP-352972785-172.31.14.131-1690218384659 heartbeating to localhost/127.0.0.1:41733] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-352972785-172.31.14.131-1690218384659 (Datanode Uuid dd03fff4-f7b9-4819-9dec-c00e282f7fd6) service to localhost/127.0.0.1:41733 2023-07-24 17:09:49,112 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/cluster_4cc708a3-96e2-4835-db32-d049ee6d4ce3/dfs/data/data1/current/BP-352972785-172.31.14.131-1690218384659] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 17:09:49,112 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aa636e75-f8ab-a9b1-07a6-3572166e56f7/cluster_4cc708a3-96e2-4835-db32-d049ee6d4ce3/dfs/data/data2/current/BP-352972785-172.31.14.131-1690218384659] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 17:09:49,140 INFO [Listener at jenkins-hbase4.apache.org/34881] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-24 17:09:49,297 INFO [Listener at jenkins-hbase4.apache.org/34881] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-24 17:09:49,406 INFO [Listener at jenkins-hbase4.apache.org/34881] hbase.HBaseTestingUtility(1293): Minicluster is down