2023-07-14 05:11:46,739 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-14 05:11:47,016 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd 2023-07-14 05:11:47,016 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot timeout: 13 mins 2023-07-14 05:11:47,056 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-14 05:11:47,306 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-14 05:11:47,307 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/cluster_0a5de1ae-f170-3a29-48d6-c867fdd6855b, deleteOnExit=true 2023-07-14 05:11:47,307 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-14 05:11:47,308 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/test.cache.data in system properties and HBase conf 2023-07-14 05:11:47,309 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/hadoop.tmp.dir in system properties and HBase conf 2023-07-14 05:11:47,309 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/hadoop.log.dir in system properties and HBase conf 2023-07-14 05:11:47,310 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-14 05:11:47,310 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-14 05:11:47,310 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-14 05:11:47,645 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-14 05:11:47,651 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-14 05:11:47,652 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-14 05:11:47,652 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-14 05:11:47,653 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-14 05:11:47,653 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-14 05:11:47,654 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-14 05:11:47,654 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-14 05:11:47,655 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-14 05:11:47,655 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-14 05:11:47,656 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/nfs.dump.dir in system properties and HBase conf 2023-07-14 05:11:47,656 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/java.io.tmpdir in system properties and HBase conf 2023-07-14 05:11:47,656 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-14 05:11:47,657 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-14 05:11:47,657 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-14 05:11:48,270 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-14 05:11:48,274 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-14 05:11:48,547 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-14 05:11:48,716 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-14 05:11:48,734 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 05:11:48,773 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 05:11:48,807 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/java.io.tmpdir/Jetty_localhost_42365_hdfs____3svd7i/webapp 2023-07-14 05:11:48,961 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42365 2023-07-14 05:11:49,020 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-14 05:11:49,020 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-14 05:11:49,574 WARN [Listener at localhost/36535] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-14 05:11:49,663 WARN [Listener at localhost/36535] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-14 05:11:49,689 WARN [Listener at localhost/36535] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 05:11:49,697 INFO [Listener at localhost/36535] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 05:11:49,704 INFO [Listener at localhost/36535] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/java.io.tmpdir/Jetty_localhost_42455_datanode____twxkzh/webapp 2023-07-14 05:11:49,850 INFO [Listener at localhost/36535] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42455 2023-07-14 05:11:50,368 WARN [Listener at localhost/45653] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-14 05:11:50,417 WARN [Listener at localhost/45653] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-14 05:11:50,422 WARN [Listener at localhost/45653] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 05:11:50,423 INFO [Listener at localhost/45653] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 05:11:50,429 INFO [Listener at localhost/45653] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/java.io.tmpdir/Jetty_localhost_33227_datanode____.ze8ute/webapp 2023-07-14 05:11:50,560 INFO [Listener at localhost/45653] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33227 2023-07-14 05:11:50,591 WARN [Listener at localhost/42303] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-14 05:11:50,633 WARN [Listener at localhost/42303] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-14 05:11:50,636 WARN [Listener at localhost/42303] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 05:11:50,637 INFO [Listener at localhost/42303] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 05:11:50,642 INFO [Listener at localhost/42303] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/java.io.tmpdir/Jetty_localhost_40697_datanode____.hii3b5/webapp 2023-07-14 05:11:50,782 INFO [Listener at localhost/42303] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40697 2023-07-14 05:11:50,803 WARN [Listener at localhost/35767] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-14 05:11:51,103 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbaf0cc7fd71f35e: Processing first storage report for DS-24372310-f42b-47a9-9ed1-e473f4eaceac from datanode 3bfc0b14-bb08-4aac-b8b5-359e3c247c4a 2023-07-14 05:11:51,105 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbaf0cc7fd71f35e: from storage DS-24372310-f42b-47a9-9ed1-e473f4eaceac node DatanodeRegistration(127.0.0.1:33613, datanodeUuid=3bfc0b14-bb08-4aac-b8b5-359e3c247c4a, infoPort=39657, infoSecurePort=0, ipcPort=42303, storageInfo=lv=-57;cid=testClusterID;nsid=652527929;c=1689311508345), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-14 05:11:51,105 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7240041f28af5345: Processing first storage report for DS-9971e6e5-46ae-475c-8309-10cc50612f15 from datanode fce7a1c9-fe66-400a-8ffd-c522b3de3f8d 2023-07-14 05:11:51,105 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7240041f28af5345: from storage DS-9971e6e5-46ae-475c-8309-10cc50612f15 node DatanodeRegistration(127.0.0.1:33387, datanodeUuid=fce7a1c9-fe66-400a-8ffd-c522b3de3f8d, infoPort=45685, infoSecurePort=0, ipcPort=45653, storageInfo=lv=-57;cid=testClusterID;nsid=652527929;c=1689311508345), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-14 05:11:51,105 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbaf0cc7fd71f35e: Processing first storage report for DS-4495fa0c-c753-479d-ae6d-a7c8bcb68d4e from datanode 3bfc0b14-bb08-4aac-b8b5-359e3c247c4a 2023-07-14 05:11:51,106 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbaf0cc7fd71f35e: from storage DS-4495fa0c-c753-479d-ae6d-a7c8bcb68d4e node DatanodeRegistration(127.0.0.1:33613, datanodeUuid=3bfc0b14-bb08-4aac-b8b5-359e3c247c4a, infoPort=39657, infoSecurePort=0, ipcPort=42303, storageInfo=lv=-57;cid=testClusterID;nsid=652527929;c=1689311508345), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-14 05:11:51,106 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbe454449fe8f68d2: Processing first storage report for DS-173c38f4-5367-4563-ab57-f8ae80bce5f8 from datanode fdccf12e-6cf3-41e9-9102-3af0f83ade5d 2023-07-14 05:11:51,106 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbe454449fe8f68d2: from storage DS-173c38f4-5367-4563-ab57-f8ae80bce5f8 node DatanodeRegistration(127.0.0.1:40643, datanodeUuid=fdccf12e-6cf3-41e9-9102-3af0f83ade5d, infoPort=38991, infoSecurePort=0, ipcPort=35767, storageInfo=lv=-57;cid=testClusterID;nsid=652527929;c=1689311508345), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-14 05:11:51,106 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7240041f28af5345: Processing first storage report for DS-2a5d4ed1-3e09-42ef-9b5d-17808262a51c from datanode fce7a1c9-fe66-400a-8ffd-c522b3de3f8d 2023-07-14 05:11:51,106 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7240041f28af5345: from storage DS-2a5d4ed1-3e09-42ef-9b5d-17808262a51c node DatanodeRegistration(127.0.0.1:33387, datanodeUuid=fce7a1c9-fe66-400a-8ffd-c522b3de3f8d, infoPort=45685, infoSecurePort=0, ipcPort=45653, storageInfo=lv=-57;cid=testClusterID;nsid=652527929;c=1689311508345), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-14 05:11:51,106 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbe454449fe8f68d2: Processing first storage report for DS-70285f48-1a08-483a-96b0-01943382eb23 from datanode fdccf12e-6cf3-41e9-9102-3af0f83ade5d 2023-07-14 05:11:51,106 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbe454449fe8f68d2: from storage DS-70285f48-1a08-483a-96b0-01943382eb23 node DatanodeRegistration(127.0.0.1:40643, datanodeUuid=fdccf12e-6cf3-41e9-9102-3af0f83ade5d, infoPort=38991, infoSecurePort=0, ipcPort=35767, storageInfo=lv=-57;cid=testClusterID;nsid=652527929;c=1689311508345), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-14 05:11:51,298 DEBUG [Listener at localhost/35767] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd 2023-07-14 05:11:51,398 INFO [Listener at localhost/35767] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/cluster_0a5de1ae-f170-3a29-48d6-c867fdd6855b/zookeeper_0, clientPort=55310, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/cluster_0a5de1ae-f170-3a29-48d6-c867fdd6855b/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/cluster_0a5de1ae-f170-3a29-48d6-c867fdd6855b/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-14 05:11:51,421 INFO [Listener at localhost/35767] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=55310 2023-07-14 05:11:51,433 INFO [Listener at localhost/35767] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 05:11:51,436 INFO [Listener at localhost/35767] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 05:11:52,132 INFO [Listener at localhost/35767] util.FSUtils(471): Created version file at hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48 with version=8 2023-07-14 05:11:52,132 INFO [Listener at localhost/35767] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/hbase-staging 2023-07-14 05:11:52,499 INFO [Listener at localhost/35767] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-14 05:11:53,115 INFO [Listener at localhost/35767] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-14 05:11:53,151 INFO [Listener at localhost/35767] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 05:11:53,151 INFO [Listener at localhost/35767] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-14 05:11:53,151 INFO [Listener at localhost/35767] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-14 05:11:53,152 INFO [Listener at localhost/35767] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 05:11:53,152 INFO [Listener at localhost/35767] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-14 05:11:53,312 INFO [Listener at localhost/35767] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-14 05:11:53,395 DEBUG [Listener at localhost/35767] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-14 05:11:53,508 INFO [Listener at localhost/35767] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35845 2023-07-14 05:11:53,522 INFO [Listener at localhost/35767] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 05:11:53,525 INFO [Listener at localhost/35767] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 05:11:53,550 INFO [Listener at localhost/35767] zookeeper.RecoverableZooKeeper(93): Process identifier=master:35845 connecting to ZooKeeper ensemble=127.0.0.1:55310 2023-07-14 05:11:53,607 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:358450x0, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-14 05:11:53,610 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:35845-0x101623e86490000 connected 2023-07-14 05:11:53,648 DEBUG [Listener at localhost/35767] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-14 05:11:53,649 DEBUG [Listener at localhost/35767] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 05:11:53,667 DEBUG [Listener at localhost/35767] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-14 05:11:53,676 DEBUG [Listener at localhost/35767] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35845 2023-07-14 05:11:53,677 DEBUG [Listener at localhost/35767] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35845 2023-07-14 05:11:53,677 DEBUG [Listener at localhost/35767] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35845 2023-07-14 05:11:53,678 DEBUG [Listener at localhost/35767] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35845 2023-07-14 05:11:53,679 DEBUG [Listener at localhost/35767] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35845 2023-07-14 05:11:53,686 INFO [Listener at localhost/35767] master.HMaster(444): hbase.rootdir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48, hbase.cluster.distributed=false 2023-07-14 05:11:53,756 INFO [Listener at localhost/35767] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-14 05:11:53,756 INFO [Listener at localhost/35767] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 05:11:53,757 INFO [Listener at localhost/35767] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-14 05:11:53,757 INFO [Listener at localhost/35767] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-14 05:11:53,757 INFO [Listener at localhost/35767] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 05:11:53,757 INFO [Listener at localhost/35767] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-14 05:11:53,762 INFO [Listener at localhost/35767] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-14 05:11:53,765 INFO [Listener at localhost/35767] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35487 2023-07-14 05:11:53,768 INFO [Listener at localhost/35767] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-14 05:11:53,777 DEBUG [Listener at localhost/35767] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-14 05:11:53,779 INFO [Listener at localhost/35767] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 05:11:53,781 INFO [Listener at localhost/35767] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 05:11:53,783 INFO [Listener at localhost/35767] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35487 connecting to ZooKeeper ensemble=127.0.0.1:55310 2023-07-14 05:11:53,794 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:354870x0, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-14 05:11:53,795 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:35487-0x101623e86490001 connected 2023-07-14 05:11:53,795 DEBUG [Listener at localhost/35767] zookeeper.ZKUtil(164): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-14 05:11:53,797 DEBUG [Listener at localhost/35767] zookeeper.ZKUtil(164): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 05:11:53,798 DEBUG [Listener at localhost/35767] zookeeper.ZKUtil(164): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-14 05:11:53,805 DEBUG [Listener at localhost/35767] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35487 2023-07-14 05:11:53,806 DEBUG [Listener at localhost/35767] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35487 2023-07-14 05:11:53,810 DEBUG [Listener at localhost/35767] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35487 2023-07-14 05:11:53,812 DEBUG [Listener at localhost/35767] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35487 2023-07-14 05:11:53,812 DEBUG [Listener at localhost/35767] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35487 2023-07-14 05:11:53,826 INFO [Listener at localhost/35767] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-14 05:11:53,826 INFO [Listener at localhost/35767] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 05:11:53,827 INFO [Listener at localhost/35767] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-14 05:11:53,827 INFO [Listener at localhost/35767] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-14 05:11:53,828 INFO [Listener at localhost/35767] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 05:11:53,828 INFO [Listener at localhost/35767] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-14 05:11:53,828 INFO [Listener at localhost/35767] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-14 05:11:53,832 INFO [Listener at localhost/35767] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35535 2023-07-14 05:11:53,832 INFO [Listener at localhost/35767] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-14 05:11:53,833 DEBUG [Listener at localhost/35767] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-14 05:11:53,834 INFO [Listener at localhost/35767] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 05:11:53,837 INFO [Listener at localhost/35767] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 05:11:53,842 INFO [Listener at localhost/35767] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35535 connecting to ZooKeeper ensemble=127.0.0.1:55310 2023-07-14 05:11:53,853 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:355350x0, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-14 05:11:53,855 DEBUG [Listener at localhost/35767] zookeeper.ZKUtil(164): regionserver:355350x0, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-14 05:11:53,855 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:35535-0x101623e86490002 connected 2023-07-14 05:11:53,857 DEBUG [Listener at localhost/35767] zookeeper.ZKUtil(164): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 05:11:53,858 DEBUG [Listener at localhost/35767] zookeeper.ZKUtil(164): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-14 05:11:53,862 DEBUG [Listener at localhost/35767] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35535 2023-07-14 05:11:53,866 DEBUG [Listener at localhost/35767] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35535 2023-07-14 05:11:53,868 DEBUG [Listener at localhost/35767] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35535 2023-07-14 05:11:53,870 DEBUG [Listener at localhost/35767] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35535 2023-07-14 05:11:53,874 DEBUG [Listener at localhost/35767] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35535 2023-07-14 05:11:53,889 INFO [Listener at localhost/35767] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-14 05:11:53,889 INFO [Listener at localhost/35767] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 05:11:53,889 INFO [Listener at localhost/35767] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-14 05:11:53,889 INFO [Listener at localhost/35767] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-14 05:11:53,889 INFO [Listener at localhost/35767] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 05:11:53,890 INFO [Listener at localhost/35767] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-14 05:11:53,890 INFO [Listener at localhost/35767] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-14 05:11:53,891 INFO [Listener at localhost/35767] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43331 2023-07-14 05:11:53,892 INFO [Listener at localhost/35767] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-14 05:11:53,898 DEBUG [Listener at localhost/35767] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-14 05:11:53,900 INFO [Listener at localhost/35767] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 05:11:53,901 INFO [Listener at localhost/35767] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 05:11:53,903 INFO [Listener at localhost/35767] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43331 connecting to ZooKeeper ensemble=127.0.0.1:55310 2023-07-14 05:11:53,915 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:433310x0, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-14 05:11:53,916 DEBUG [Listener at localhost/35767] zookeeper.ZKUtil(164): regionserver:433310x0, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-14 05:11:53,917 DEBUG [Listener at localhost/35767] zookeeper.ZKUtil(164): regionserver:433310x0, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 05:11:53,917 DEBUG [Listener at localhost/35767] zookeeper.ZKUtil(164): regionserver:433310x0, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-14 05:11:53,927 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:43331-0x101623e86490003 connected 2023-07-14 05:11:53,927 DEBUG [Listener at localhost/35767] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43331 2023-07-14 05:11:53,927 DEBUG [Listener at localhost/35767] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43331 2023-07-14 05:11:53,931 DEBUG [Listener at localhost/35767] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43331 2023-07-14 05:11:53,931 DEBUG [Listener at localhost/35767] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43331 2023-07-14 05:11:53,931 DEBUG [Listener at localhost/35767] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43331 2023-07-14 05:11:53,933 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,35845,1689311512312 2023-07-14 05:11:53,946 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-14 05:11:53,952 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,35845,1689311512312 2023-07-14 05:11:53,974 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-14 05:11:53,974 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-14 05:11:53,974 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-14 05:11:53,976 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 05:11:53,976 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-14 05:11:53,977 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-14 05:11:53,979 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,35845,1689311512312 from backup master directory 2023-07-14 05:11:53,979 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-14 05:11:53,990 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,35845,1689311512312 2023-07-14 05:11:53,990 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-14 05:11:53,991 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-14 05:11:53,991 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,35845,1689311512312 2023-07-14 05:11:53,995 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-14 05:11:53,999 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-14 05:11:54,153 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/hbase.id with ID: 6ce2e4f9-c78b-43bf-a8a4-9e6a622992dc 2023-07-14 05:11:54,200 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 05:11:54,219 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 05:11:54,283 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x06af1936 to 127.0.0.1:55310 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 05:11:54,337 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@271b73a8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 05:11:54,364 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-14 05:11:54,366 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-14 05:11:54,386 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-14 05:11:54,386 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-14 05:11:54,389 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-14 05:11:54,394 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-14 05:11:54,396 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-14 05:11:54,435 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/MasterData/data/master/store-tmp 2023-07-14 05:11:54,483 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 05:11:54,483 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-14 05:11:54,483 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 05:11:54,483 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 05:11:54,483 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-14 05:11:54,483 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 05:11:54,484 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 05:11:54,484 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-14 05:11:54,487 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/MasterData/WALs/jenkins-hbase4.apache.org,35845,1689311512312 2023-07-14 05:11:54,513 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35845%2C1689311512312, suffix=, logDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/MasterData/WALs/jenkins-hbase4.apache.org,35845,1689311512312, archiveDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/MasterData/oldWALs, maxLogs=10 2023-07-14 05:11:54,597 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40643,DS-173c38f4-5367-4563-ab57-f8ae80bce5f8,DISK] 2023-07-14 05:11:54,603 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33387,DS-9971e6e5-46ae-475c-8309-10cc50612f15,DISK] 2023-07-14 05:11:54,597 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33613,DS-24372310-f42b-47a9-9ed1-e473f4eaceac,DISK] 2023-07-14 05:11:54,614 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-14 05:11:54,699 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/MasterData/WALs/jenkins-hbase4.apache.org,35845,1689311512312/jenkins-hbase4.apache.org%2C35845%2C1689311512312.1689311514527 2023-07-14 05:11:54,703 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33613,DS-24372310-f42b-47a9-9ed1-e473f4eaceac,DISK], DatanodeInfoWithStorage[127.0.0.1:33387,DS-9971e6e5-46ae-475c-8309-10cc50612f15,DISK], DatanodeInfoWithStorage[127.0.0.1:40643,DS-173c38f4-5367-4563-ab57-f8ae80bce5f8,DISK]] 2023-07-14 05:11:54,704 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-14 05:11:54,704 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 05:11:54,708 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-14 05:11:54,710 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-14 05:11:54,806 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-14 05:11:54,815 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-14 05:11:54,856 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-14 05:11:54,873 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 05:11:54,880 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-14 05:11:54,882 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-14 05:11:54,902 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-14 05:11:54,912 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 05:11:54,914 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59959539, jitterRate=-0.1065332442522049}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 05:11:54,914 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-14 05:11:54,924 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-14 05:11:54,953 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-14 05:11:54,953 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-14 05:11:54,957 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-14 05:11:54,959 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-14 05:11:55,004 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 44 msec 2023-07-14 05:11:55,004 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-14 05:11:55,046 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-14 05:11:55,055 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-14 05:11:55,090 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-14 05:11:55,098 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-14 05:11:55,101 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-14 05:11:55,108 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-14 05:11:55,112 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-14 05:11:55,115 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 05:11:55,117 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-14 05:11:55,119 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-14 05:11:55,132 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-14 05:11:55,137 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-14 05:11:55,138 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-14 05:11:55,138 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-14 05:11:55,138 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-14 05:11:55,138 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,35845,1689311512312, sessionid=0x101623e86490000, setting cluster-up flag (Was=false) 2023-07-14 05:11:55,138 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 05:11:55,160 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 05:11:55,177 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-14 05:11:55,180 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35845,1689311512312 2023-07-14 05:11:55,189 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 05:11:55,196 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-14 05:11:55,198 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35845,1689311512312 2023-07-14 05:11:55,202 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/.tmp 2023-07-14 05:11:55,237 INFO [RS:0;jenkins-hbase4:35487] regionserver.HRegionServer(951): ClusterId : 6ce2e4f9-c78b-43bf-a8a4-9e6a622992dc 2023-07-14 05:11:55,239 INFO [RS:2;jenkins-hbase4:43331] regionserver.HRegionServer(951): ClusterId : 6ce2e4f9-c78b-43bf-a8a4-9e6a622992dc 2023-07-14 05:11:55,239 INFO [RS:1;jenkins-hbase4:35535] regionserver.HRegionServer(951): ClusterId : 6ce2e4f9-c78b-43bf-a8a4-9e6a622992dc 2023-07-14 05:11:55,246 DEBUG [RS:2;jenkins-hbase4:43331] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-14 05:11:55,246 DEBUG [RS:0;jenkins-hbase4:35487] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-14 05:11:55,251 DEBUG [RS:1;jenkins-hbase4:35535] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-14 05:11:55,260 DEBUG [RS:0;jenkins-hbase4:35487] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-14 05:11:55,260 DEBUG [RS:1;jenkins-hbase4:35535] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-14 05:11:55,260 DEBUG [RS:2;jenkins-hbase4:43331] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-14 05:11:55,260 DEBUG [RS:1;jenkins-hbase4:35535] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-14 05:11:55,260 DEBUG [RS:0;jenkins-hbase4:35487] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-14 05:11:55,260 DEBUG [RS:2;jenkins-hbase4:43331] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-14 05:11:55,265 DEBUG [RS:0;jenkins-hbase4:35487] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-14 05:11:55,268 DEBUG [RS:0;jenkins-hbase4:35487] zookeeper.ReadOnlyZKClient(139): Connect 0x46b6217d to 127.0.0.1:55310 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 05:11:55,271 DEBUG [RS:1;jenkins-hbase4:35535] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-14 05:11:55,271 DEBUG [RS:2;jenkins-hbase4:43331] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-14 05:11:55,275 DEBUG [RS:1;jenkins-hbase4:35535] zookeeper.ReadOnlyZKClient(139): Connect 0x57c3f6f8 to 127.0.0.1:55310 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 05:11:55,279 DEBUG [RS:2;jenkins-hbase4:43331] zookeeper.ReadOnlyZKClient(139): Connect 0x03b82b8e to 127.0.0.1:55310 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 05:11:55,303 DEBUG [RS:0;jenkins-hbase4:35487] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@66620367, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 05:11:55,306 DEBUG [RS:0;jenkins-hbase4:35487] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@189b2698, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-14 05:11:55,303 DEBUG [RS:2;jenkins-hbase4:43331] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@679fd7fc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 05:11:55,309 DEBUG [RS:2;jenkins-hbase4:43331] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7bcec75b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-14 05:11:55,325 DEBUG [RS:1;jenkins-hbase4:35535] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f8d4805, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 05:11:55,325 DEBUG [RS:1;jenkins-hbase4:35535] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f2d002a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-14 05:11:55,340 DEBUG [RS:0;jenkins-hbase4:35487] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:35487 2023-07-14 05:11:55,340 DEBUG [RS:1;jenkins-hbase4:35535] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:35535 2023-07-14 05:11:55,350 INFO [RS:0;jenkins-hbase4:35487] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-14 05:11:55,350 INFO [RS:0;jenkins-hbase4:35487] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-14 05:11:55,358 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-14 05:11:55,360 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 05:11:55,360 DEBUG [RS:0;jenkins-hbase4:35487] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-14 05:11:55,360 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-14 05:11:55,361 INFO [RS:1;jenkins-hbase4:35535] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-14 05:11:55,363 INFO [RS:1;jenkins-hbase4:35535] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-14 05:11:55,363 DEBUG [RS:1;jenkins-hbase4:35535] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-14 05:11:55,364 INFO [RS:0;jenkins-hbase4:35487] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 05:11:55,366 DEBUG [RS:0;jenkins-hbase4:35487] regionserver.HRegionServer(1022): About to register with Master. 2023-07-14 05:11:55,363 INFO [RS:1;jenkins-hbase4:35535] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 05:11:55,367 DEBUG [RS:1;jenkins-hbase4:35535] regionserver.HRegionServer(1022): About to register with Master. 2023-07-14 05:11:55,372 DEBUG [RS:2;jenkins-hbase4:43331] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:43331 2023-07-14 05:11:55,372 INFO [RS:2;jenkins-hbase4:43331] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-14 05:11:55,372 INFO [RS:2;jenkins-hbase4:43331] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-14 05:11:55,372 DEBUG [RS:2;jenkins-hbase4:43331] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-14 05:11:55,372 INFO [RS:2;jenkins-hbase4:43331] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 05:11:55,372 DEBUG [RS:2;jenkins-hbase4:43331] regionserver.HRegionServer(1022): About to register with Master. 2023-07-14 05:11:55,373 INFO [RS:1;jenkins-hbase4:35535] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,35845,1689311512312 with isa=jenkins-hbase4.apache.org/172.31.14.131:35535, startcode=1689311513825 2023-07-14 05:11:55,373 INFO [RS:2;jenkins-hbase4:43331] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,35845,1689311512312 with isa=jenkins-hbase4.apache.org/172.31.14.131:43331, startcode=1689311513888 2023-07-14 05:11:55,373 INFO [RS:0;jenkins-hbase4:35487] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,35845,1689311512312 with isa=jenkins-hbase4.apache.org/172.31.14.131:35487, startcode=1689311513755 2023-07-14 05:11:55,397 DEBUG [RS:0;jenkins-hbase4:35487] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-14 05:11:55,397 DEBUG [RS:2;jenkins-hbase4:43331] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-14 05:11:55,397 DEBUG [RS:1;jenkins-hbase4:35535] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-14 05:11:55,478 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46093, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-14 05:11:55,480 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-14 05:11:55,478 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38605, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-14 05:11:55,478 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60007, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-14 05:11:55,491 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35845] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-14 05:11:55,495 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-14 05:11:55,496 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-14 05:11:55,496 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-14 05:11:55,496 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-14 05:11:55,496 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-14 05:11:55,496 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-14 05:11:55,496 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-14 05:11:55,496 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-14 05:11:55,500 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35845] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-14 05:11:55,501 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35845] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-14 05:11:55,505 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689311545505 2023-07-14 05:11:55,507 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-14 05:11:55,522 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-14 05:11:55,523 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-14 05:11:55,524 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-14 05:11:55,529 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-14 05:11:55,533 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-14 05:11:55,534 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-14 05:11:55,536 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-14 05:11:55,536 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-14 05:11:55,539 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-14 05:11:55,540 DEBUG [RS:1;jenkins-hbase4:35535] regionserver.HRegionServer(2830): Master is not running yet 2023-07-14 05:11:55,547 DEBUG [RS:2;jenkins-hbase4:43331] regionserver.HRegionServer(2830): Master is not running yet 2023-07-14 05:11:55,547 WARN [RS:1;jenkins-hbase4:35535] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-14 05:11:55,547 DEBUG [RS:0;jenkins-hbase4:35487] regionserver.HRegionServer(2830): Master is not running yet 2023-07-14 05:11:55,547 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-14 05:11:55,547 WARN [RS:2;jenkins-hbase4:43331] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-14 05:11:55,547 WARN [RS:0;jenkins-hbase4:35487] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-14 05:11:55,551 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-14 05:11:55,551 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-14 05:11:55,559 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-14 05:11:55,560 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-14 05:11:55,562 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689311515562,5,FailOnTimeoutGroup] 2023-07-14 05:11:55,564 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689311515562,5,FailOnTimeoutGroup] 2023-07-14 05:11:55,564 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-14 05:11:55,564 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-14 05:11:55,569 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-14 05:11:55,570 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-14 05:11:55,617 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-14 05:11:55,618 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-14 05:11:55,619 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48 2023-07-14 05:11:55,649 INFO [RS:1;jenkins-hbase4:35535] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,35845,1689311512312 with isa=jenkins-hbase4.apache.org/172.31.14.131:35535, startcode=1689311513825 2023-07-14 05:11:55,649 INFO [RS:2;jenkins-hbase4:43331] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,35845,1689311512312 with isa=jenkins-hbase4.apache.org/172.31.14.131:43331, startcode=1689311513888 2023-07-14 05:11:55,649 INFO [RS:0;jenkins-hbase4:35487] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,35845,1689311512312 with isa=jenkins-hbase4.apache.org/172.31.14.131:35487, startcode=1689311513755 2023-07-14 05:11:55,682 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35845] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:11:55,696 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35845] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:11:55,698 DEBUG [RS:1;jenkins-hbase4:35535] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48 2023-07-14 05:11:55,699 DEBUG [RS:0;jenkins-hbase4:35487] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48 2023-07-14 05:11:55,699 DEBUG [RS:0;jenkins-hbase4:35487] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36535 2023-07-14 05:11:55,699 DEBUG [RS:0;jenkins-hbase4:35487] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-14 05:11:55,699 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35845] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:11:55,699 DEBUG [RS:1;jenkins-hbase4:35535] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36535 2023-07-14 05:11:55,700 DEBUG [RS:1;jenkins-hbase4:35535] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-14 05:11:55,702 DEBUG [RS:2;jenkins-hbase4:43331] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48 2023-07-14 05:11:55,702 DEBUG [RS:2;jenkins-hbase4:43331] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36535 2023-07-14 05:11:55,702 DEBUG [RS:2;jenkins-hbase4:43331] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-14 05:11:55,704 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 05:11:55,708 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-14 05:11:55,710 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 05:11:55,712 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/hbase/meta/1588230740/info 2023-07-14 05:11:55,712 DEBUG [RS:0;jenkins-hbase4:35487] zookeeper.ZKUtil(162): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:11:55,712 DEBUG [RS:2;jenkins-hbase4:43331] zookeeper.ZKUtil(162): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:11:55,712 DEBUG [RS:1;jenkins-hbase4:35535] zookeeper.ZKUtil(162): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:11:55,712 WARN [RS:0;jenkins-hbase4:35487] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-14 05:11:55,712 WARN [RS:2;jenkins-hbase4:43331] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-14 05:11:55,713 INFO [RS:0;jenkins-hbase4:35487] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-14 05:11:55,714 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-14 05:11:55,714 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43331,1689311513888] 2023-07-14 05:11:55,714 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35535,1689311513825] 2023-07-14 05:11:55,714 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35487,1689311513755] 2023-07-14 05:11:55,713 WARN [RS:1;jenkins-hbase4:35535] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-14 05:11:55,717 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 05:11:55,717 INFO [RS:1;jenkins-hbase4:35535] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-14 05:11:55,717 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-14 05:11:55,713 INFO [RS:2;jenkins-hbase4:43331] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-14 05:11:55,716 DEBUG [RS:0;jenkins-hbase4:35487] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/WALs/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:11:55,717 DEBUG [RS:2;jenkins-hbase4:43331] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/WALs/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:11:55,717 DEBUG [RS:1;jenkins-hbase4:35535] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/WALs/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:11:55,721 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/hbase/meta/1588230740/rep_barrier 2023-07-14 05:11:55,721 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-14 05:11:55,722 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 05:11:55,723 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-14 05:11:55,741 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/hbase/meta/1588230740/table 2023-07-14 05:11:55,742 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-14 05:11:55,744 DEBUG [RS:1;jenkins-hbase4:35535] zookeeper.ZKUtil(162): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:11:55,745 DEBUG [RS:2;jenkins-hbase4:43331] zookeeper.ZKUtil(162): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:11:55,751 DEBUG [RS:2;jenkins-hbase4:43331] zookeeper.ZKUtil(162): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:11:55,750 DEBUG [RS:0;jenkins-hbase4:35487] zookeeper.ZKUtil(162): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:11:55,745 DEBUG [RS:1;jenkins-hbase4:35535] zookeeper.ZKUtil(162): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:11:55,752 DEBUG [RS:2;jenkins-hbase4:43331] zookeeper.ZKUtil(162): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:11:55,753 DEBUG [RS:0;jenkins-hbase4:35487] zookeeper.ZKUtil(162): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:11:55,754 DEBUG [RS:0;jenkins-hbase4:35487] zookeeper.ZKUtil(162): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:11:55,745 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 05:11:55,753 DEBUG [RS:1;jenkins-hbase4:35535] zookeeper.ZKUtil(162): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:11:55,784 DEBUG [RS:2;jenkins-hbase4:43331] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-14 05:11:55,786 DEBUG [RS:0;jenkins-hbase4:35487] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-14 05:11:55,806 INFO [RS:0;jenkins-hbase4:35487] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-14 05:11:55,807 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/hbase/meta/1588230740 2023-07-14 05:11:55,807 DEBUG [RS:1;jenkins-hbase4:35535] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-14 05:11:55,807 INFO [RS:2;jenkins-hbase4:43331] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-14 05:11:55,809 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/hbase/meta/1588230740 2023-07-14 05:11:55,814 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-14 05:11:55,818 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-14 05:11:55,834 INFO [RS:1;jenkins-hbase4:35535] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-14 05:11:55,842 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 05:11:55,843 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61591879, jitterRate=-0.08220948278903961}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-14 05:11:55,843 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-14 05:11:55,843 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-14 05:11:55,843 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-14 05:11:55,843 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-14 05:11:55,843 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-14 05:11:55,844 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-14 05:11:55,854 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-14 05:11:55,854 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-14 05:11:55,855 INFO [RS:1;jenkins-hbase4:35535] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-14 05:11:55,855 INFO [RS:0;jenkins-hbase4:35487] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-14 05:11:55,855 INFO [RS:2;jenkins-hbase4:43331] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-14 05:11:55,861 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-14 05:11:55,861 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-14 05:11:55,882 INFO [RS:1;jenkins-hbase4:35535] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-14 05:11:55,882 INFO [RS:2;jenkins-hbase4:43331] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-14 05:11:55,887 INFO [RS:1;jenkins-hbase4:35535] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 05:11:55,887 INFO [RS:2;jenkins-hbase4:43331] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 05:11:55,892 INFO [RS:0;jenkins-hbase4:35487] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-14 05:11:55,892 INFO [RS:0;jenkins-hbase4:35487] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 05:11:55,909 INFO [RS:0;jenkins-hbase4:35487] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-14 05:11:55,909 INFO [RS:1;jenkins-hbase4:35535] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-14 05:11:55,909 INFO [RS:2;jenkins-hbase4:43331] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-14 05:11:55,920 INFO [RS:0;jenkins-hbase4:35487] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-14 05:11:55,921 INFO [RS:2;jenkins-hbase4:43331] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-14 05:11:55,921 DEBUG [RS:0;jenkins-hbase4:35487] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-14 05:11:55,921 DEBUG [RS:2;jenkins-hbase4:43331] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-14 05:11:55,922 DEBUG [RS:0;jenkins-hbase4:35487] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-14 05:11:55,922 DEBUG [RS:2;jenkins-hbase4:43331] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-14 05:11:55,922 DEBUG [RS:0;jenkins-hbase4:35487] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-14 05:11:55,922 DEBUG [RS:2;jenkins-hbase4:43331] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-14 05:11:55,922 DEBUG [RS:0;jenkins-hbase4:35487] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-14 05:11:55,922 DEBUG [RS:2;jenkins-hbase4:43331] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-14 05:11:55,922 DEBUG [RS:0;jenkins-hbase4:35487] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-14 05:11:55,923 DEBUG [RS:2;jenkins-hbase4:43331] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-14 05:11:55,923 DEBUG [RS:0;jenkins-hbase4:35487] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-14 05:11:55,923 DEBUG [RS:2;jenkins-hbase4:43331] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-14 05:11:55,923 DEBUG [RS:0;jenkins-hbase4:35487] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-14 05:11:55,923 DEBUG [RS:2;jenkins-hbase4:43331] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-14 05:11:55,923 DEBUG [RS:0;jenkins-hbase4:35487] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-14 05:11:55,923 DEBUG [RS:2;jenkins-hbase4:43331] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-14 05:11:55,923 DEBUG [RS:0;jenkins-hbase4:35487] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-14 05:11:55,923 DEBUG [RS:2;jenkins-hbase4:43331] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-14 05:11:55,923 DEBUG [RS:0;jenkins-hbase4:35487] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-14 05:11:55,923 DEBUG [RS:2;jenkins-hbase4:43331] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-14 05:11:55,924 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-14 05:11:55,922 INFO [RS:1;jenkins-hbase4:35535] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-14 05:11:55,927 DEBUG [RS:1;jenkins-hbase4:35535] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-14 05:11:55,928 DEBUG [RS:1;jenkins-hbase4:35535] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-14 05:11:55,928 DEBUG [RS:1;jenkins-hbase4:35535] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-14 05:11:55,928 DEBUG [RS:1;jenkins-hbase4:35535] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-14 05:11:55,928 DEBUG [RS:1;jenkins-hbase4:35535] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-14 05:11:55,928 DEBUG [RS:1;jenkins-hbase4:35535] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-14 05:11:55,928 DEBUG [RS:1;jenkins-hbase4:35535] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-14 05:11:55,929 DEBUG [RS:1;jenkins-hbase4:35535] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-14 05:11:55,929 DEBUG [RS:1;jenkins-hbase4:35535] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-14 05:11:55,929 DEBUG [RS:1;jenkins-hbase4:35535] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-14 05:11:55,931 INFO [RS:2;jenkins-hbase4:43331] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-14 05:11:55,931 INFO [RS:2;jenkins-hbase4:43331] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-14 05:11:55,931 INFO [RS:2;jenkins-hbase4:43331] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-14 05:11:55,955 INFO [RS:0;jenkins-hbase4:35487] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-14 05:11:55,955 INFO [RS:0;jenkins-hbase4:35487] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-14 05:11:55,955 INFO [RS:0;jenkins-hbase4:35487] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-14 05:11:55,968 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-14 05:11:55,977 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-14 05:11:55,984 INFO [RS:1;jenkins-hbase4:35535] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-14 05:11:55,984 INFO [RS:1;jenkins-hbase4:35535] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-14 05:11:55,984 INFO [RS:1;jenkins-hbase4:35535] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-14 05:11:55,985 INFO [RS:0;jenkins-hbase4:35487] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-14 05:11:55,985 INFO [RS:2;jenkins-hbase4:43331] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-14 05:11:55,990 INFO [RS:2;jenkins-hbase4:43331] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43331,1689311513888-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 05:11:55,990 INFO [RS:0;jenkins-hbase4:35487] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35487,1689311513755-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 05:11:56,005 INFO [RS:1;jenkins-hbase4:35535] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-14 05:11:56,005 INFO [RS:1;jenkins-hbase4:35535] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35535,1689311513825-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 05:11:56,018 INFO [RS:2;jenkins-hbase4:43331] regionserver.Replication(203): jenkins-hbase4.apache.org,43331,1689311513888 started 2023-07-14 05:11:56,019 INFO [RS:2;jenkins-hbase4:43331] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,43331,1689311513888, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43331, sessionid=0x101623e86490003 2023-07-14 05:11:56,019 INFO [RS:0;jenkins-hbase4:35487] regionserver.Replication(203): jenkins-hbase4.apache.org,35487,1689311513755 started 2023-07-14 05:11:56,019 DEBUG [RS:2;jenkins-hbase4:43331] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-14 05:11:56,019 INFO [RS:0;jenkins-hbase4:35487] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,35487,1689311513755, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35487, sessionid=0x101623e86490001 2023-07-14 05:11:56,019 DEBUG [RS:2;jenkins-hbase4:43331] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:11:56,019 DEBUG [RS:0;jenkins-hbase4:35487] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-14 05:11:56,019 DEBUG [RS:2;jenkins-hbase4:43331] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43331,1689311513888' 2023-07-14 05:11:56,020 DEBUG [RS:0;jenkins-hbase4:35487] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:11:56,020 DEBUG [RS:2;jenkins-hbase4:43331] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-14 05:11:56,021 DEBUG [RS:0;jenkins-hbase4:35487] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35487,1689311513755' 2023-07-14 05:11:56,021 DEBUG [RS:0;jenkins-hbase4:35487] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-14 05:11:56,022 DEBUG [RS:0;jenkins-hbase4:35487] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-14 05:11:56,022 DEBUG [RS:2;jenkins-hbase4:43331] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-14 05:11:56,023 DEBUG [RS:0;jenkins-hbase4:35487] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-14 05:11:56,023 DEBUG [RS:0;jenkins-hbase4:35487] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-14 05:11:56,023 DEBUG [RS:2;jenkins-hbase4:43331] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-14 05:11:56,023 DEBUG [RS:0;jenkins-hbase4:35487] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:11:56,023 DEBUG [RS:2;jenkins-hbase4:43331] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-14 05:11:56,023 DEBUG [RS:0;jenkins-hbase4:35487] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35487,1689311513755' 2023-07-14 05:11:56,027 DEBUG [RS:0;jenkins-hbase4:35487] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:11:56,028 DEBUG [RS:0;jenkins-hbase4:35487] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:11:56,028 DEBUG [RS:0;jenkins-hbase4:35487] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-14 05:11:56,029 INFO [RS:0;jenkins-hbase4:35487] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-14 05:11:56,029 INFO [RS:0;jenkins-hbase4:35487] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-14 05:11:56,023 DEBUG [RS:2;jenkins-hbase4:43331] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:11:56,029 INFO [RS:1;jenkins-hbase4:35535] regionserver.Replication(203): jenkins-hbase4.apache.org,35535,1689311513825 started 2023-07-14 05:11:56,029 DEBUG [RS:2;jenkins-hbase4:43331] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43331,1689311513888' 2023-07-14 05:11:56,029 DEBUG [RS:2;jenkins-hbase4:43331] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:11:56,029 INFO [RS:1;jenkins-hbase4:35535] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,35535,1689311513825, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35535, sessionid=0x101623e86490002 2023-07-14 05:11:56,029 DEBUG [RS:1;jenkins-hbase4:35535] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-14 05:11:56,029 DEBUG [RS:1;jenkins-hbase4:35535] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:11:56,029 DEBUG [RS:1;jenkins-hbase4:35535] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35535,1689311513825' 2023-07-14 05:11:56,030 DEBUG [RS:1;jenkins-hbase4:35535] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-14 05:11:56,030 DEBUG [RS:2;jenkins-hbase4:43331] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:11:56,030 DEBUG [RS:1;jenkins-hbase4:35535] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-14 05:11:56,030 DEBUG [RS:2;jenkins-hbase4:43331] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-14 05:11:56,030 INFO [RS:2;jenkins-hbase4:43331] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-14 05:11:56,031 INFO [RS:2;jenkins-hbase4:43331] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-14 05:11:56,032 DEBUG [RS:1;jenkins-hbase4:35535] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-14 05:11:56,032 DEBUG [RS:1;jenkins-hbase4:35535] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-14 05:11:56,032 DEBUG [RS:1;jenkins-hbase4:35535] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:11:56,032 DEBUG [RS:1;jenkins-hbase4:35535] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35535,1689311513825' 2023-07-14 05:11:56,032 DEBUG [RS:1;jenkins-hbase4:35535] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:11:56,033 DEBUG [RS:1;jenkins-hbase4:35535] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:11:56,033 DEBUG [RS:1;jenkins-hbase4:35535] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-14 05:11:56,033 INFO [RS:1;jenkins-hbase4:35535] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-14 05:11:56,033 INFO [RS:1;jenkins-hbase4:35535] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-14 05:11:56,137 DEBUG [jenkins-hbase4:35845] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-14 05:11:56,143 INFO [RS:1;jenkins-hbase4:35535] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35535%2C1689311513825, suffix=, logDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/WALs/jenkins-hbase4.apache.org,35535,1689311513825, archiveDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/oldWALs, maxLogs=32 2023-07-14 05:11:56,147 DEBUG [jenkins-hbase4:35845] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-14 05:11:56,148 INFO [RS:2;jenkins-hbase4:43331] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43331%2C1689311513888, suffix=, logDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/WALs/jenkins-hbase4.apache.org,43331,1689311513888, archiveDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/oldWALs, maxLogs=32 2023-07-14 05:11:56,155 INFO [RS:0;jenkins-hbase4:35487] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35487%2C1689311513755, suffix=, logDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/WALs/jenkins-hbase4.apache.org,35487,1689311513755, archiveDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/oldWALs, maxLogs=32 2023-07-14 05:11:56,159 DEBUG [jenkins-hbase4:35845] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 05:11:56,159 DEBUG [jenkins-hbase4:35845] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 05:11:56,159 DEBUG [jenkins-hbase4:35845] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 05:11:56,159 DEBUG [jenkins-hbase4:35845] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 05:11:56,162 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43331,1689311513888, state=OPENING 2023-07-14 05:11:56,172 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-14 05:11:56,174 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 05:11:56,180 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-14 05:11:56,184 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43331,1689311513888}] 2023-07-14 05:11:56,224 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40643,DS-173c38f4-5367-4563-ab57-f8ae80bce5f8,DISK] 2023-07-14 05:11:56,224 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33387,DS-9971e6e5-46ae-475c-8309-10cc50612f15,DISK] 2023-07-14 05:11:56,232 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33613,DS-24372310-f42b-47a9-9ed1-e473f4eaceac,DISK] 2023-07-14 05:11:56,232 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33387,DS-9971e6e5-46ae-475c-8309-10cc50612f15,DISK] 2023-07-14 05:11:56,233 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40643,DS-173c38f4-5367-4563-ab57-f8ae80bce5f8,DISK] 2023-07-14 05:11:56,234 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33613,DS-24372310-f42b-47a9-9ed1-e473f4eaceac,DISK] 2023-07-14 05:11:56,235 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33613,DS-24372310-f42b-47a9-9ed1-e473f4eaceac,DISK] 2023-07-14 05:11:56,236 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40643,DS-173c38f4-5367-4563-ab57-f8ae80bce5f8,DISK] 2023-07-14 05:11:56,236 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33387,DS-9971e6e5-46ae-475c-8309-10cc50612f15,DISK] 2023-07-14 05:11:56,264 INFO [RS:1;jenkins-hbase4:35535] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/WALs/jenkins-hbase4.apache.org,35535,1689311513825/jenkins-hbase4.apache.org%2C35535%2C1689311513825.1689311516146 2023-07-14 05:11:56,264 INFO [RS:2;jenkins-hbase4:43331] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/WALs/jenkins-hbase4.apache.org,43331,1689311513888/jenkins-hbase4.apache.org%2C43331%2C1689311513888.1689311516154 2023-07-14 05:11:56,264 INFO [RS:0;jenkins-hbase4:35487] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/WALs/jenkins-hbase4.apache.org,35487,1689311513755/jenkins-hbase4.apache.org%2C35487%2C1689311513755.1689311516157 2023-07-14 05:11:56,273 DEBUG [RS:1;jenkins-hbase4:35535] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33613,DS-24372310-f42b-47a9-9ed1-e473f4eaceac,DISK], DatanodeInfoWithStorage[127.0.0.1:40643,DS-173c38f4-5367-4563-ab57-f8ae80bce5f8,DISK], DatanodeInfoWithStorage[127.0.0.1:33387,DS-9971e6e5-46ae-475c-8309-10cc50612f15,DISK]] 2023-07-14 05:11:56,273 DEBUG [RS:0;jenkins-hbase4:35487] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33387,DS-9971e6e5-46ae-475c-8309-10cc50612f15,DISK], DatanodeInfoWithStorage[127.0.0.1:40643,DS-173c38f4-5367-4563-ab57-f8ae80bce5f8,DISK], DatanodeInfoWithStorage[127.0.0.1:33613,DS-24372310-f42b-47a9-9ed1-e473f4eaceac,DISK]] 2023-07-14 05:11:56,274 DEBUG [RS:2;jenkins-hbase4:43331] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33387,DS-9971e6e5-46ae-475c-8309-10cc50612f15,DISK], DatanodeInfoWithStorage[127.0.0.1:33613,DS-24372310-f42b-47a9-9ed1-e473f4eaceac,DISK], DatanodeInfoWithStorage[127.0.0.1:40643,DS-173c38f4-5367-4563-ab57-f8ae80bce5f8,DISK]] 2023-07-14 05:11:56,448 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:11:56,452 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-14 05:11:56,455 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36830, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-14 05:11:56,480 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-14 05:11:56,480 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-14 05:11:56,489 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43331%2C1689311513888.meta, suffix=.meta, logDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/WALs/jenkins-hbase4.apache.org,43331,1689311513888, archiveDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/oldWALs, maxLogs=32 2023-07-14 05:11:56,524 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40643,DS-173c38f4-5367-4563-ab57-f8ae80bce5f8,DISK] 2023-07-14 05:11:56,524 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33613,DS-24372310-f42b-47a9-9ed1-e473f4eaceac,DISK] 2023-07-14 05:11:56,524 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33387,DS-9971e6e5-46ae-475c-8309-10cc50612f15,DISK] 2023-07-14 05:11:56,539 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/WALs/jenkins-hbase4.apache.org,43331,1689311513888/jenkins-hbase4.apache.org%2C43331%2C1689311513888.meta.1689311516491.meta 2023-07-14 05:11:56,542 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40643,DS-173c38f4-5367-4563-ab57-f8ae80bce5f8,DISK], DatanodeInfoWithStorage[127.0.0.1:33613,DS-24372310-f42b-47a9-9ed1-e473f4eaceac,DISK], DatanodeInfoWithStorage[127.0.0.1:33387,DS-9971e6e5-46ae-475c-8309-10cc50612f15,DISK]] 2023-07-14 05:11:56,543 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-14 05:11:56,545 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-14 05:11:56,547 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 05:11:56,547 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-14 05:11:56,550 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-14 05:11:56,551 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-14 05:11:56,566 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-14 05:11:56,566 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 05:11:56,566 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-14 05:11:56,566 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-14 05:11:56,569 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-14 05:11:56,572 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/hbase/meta/1588230740/info 2023-07-14 05:11:56,572 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/hbase/meta/1588230740/info 2023-07-14 05:11:56,572 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-14 05:11:56,574 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 05:11:56,574 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-14 05:11:56,575 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/hbase/meta/1588230740/rep_barrier 2023-07-14 05:11:56,576 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/hbase/meta/1588230740/rep_barrier 2023-07-14 05:11:56,576 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-14 05:11:56,577 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 05:11:56,577 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-14 05:11:56,579 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/hbase/meta/1588230740/table 2023-07-14 05:11:56,579 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/hbase/meta/1588230740/table 2023-07-14 05:11:56,579 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-14 05:11:56,580 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 05:11:56,582 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/hbase/meta/1588230740 2023-07-14 05:11:56,585 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/hbase/meta/1588230740 2023-07-14 05:11:56,589 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-14 05:11:56,592 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-14 05:11:56,595 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69608834, jitterRate=0.037252455949783325}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-14 05:11:56,598 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-14 05:11:56,612 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689311516437 2023-07-14 05:11:56,639 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-14 05:11:56,640 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-14 05:11:56,641 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43331,1689311513888, state=OPEN 2023-07-14 05:11:56,644 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-14 05:11:56,644 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-14 05:11:56,650 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-14 05:11:56,650 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43331,1689311513888 in 460 msec 2023-07-14 05:11:56,661 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-14 05:11:56,661 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 733 msec 2023-07-14 05:11:56,667 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.2860 sec 2023-07-14 05:11:56,668 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689311516668, completionTime=-1 2023-07-14 05:11:56,668 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-14 05:11:56,668 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-14 05:11:56,755 DEBUG [hconnection-0x11720e3f-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 05:11:56,759 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36840, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 05:11:56,786 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-14 05:11:56,786 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689311576786 2023-07-14 05:11:56,786 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689311636786 2023-07-14 05:11:56,786 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 118 msec 2023-07-14 05:11:56,810 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35845,1689311512312-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 05:11:56,810 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35845,1689311512312-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-14 05:11:56,810 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35845,1689311512312-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-14 05:11:56,812 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:35845, period=300000, unit=MILLISECONDS is enabled. 2023-07-14 05:11:56,813 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-14 05:11:56,821 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-14 05:11:56,835 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-14 05:11:56,837 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-14 05:11:56,850 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-14 05:11:56,853 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 05:11:56,856 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 05:11:56,879 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/hbase/namespace/437edc714ffa0d0a6cb653095eafbdc8 2023-07-14 05:11:56,882 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/hbase/namespace/437edc714ffa0d0a6cb653095eafbdc8 empty. 2023-07-14 05:11:56,883 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/hbase/namespace/437edc714ffa0d0a6cb653095eafbdc8 2023-07-14 05:11:56,883 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-14 05:11:56,930 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-14 05:11:56,933 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 437edc714ffa0d0a6cb653095eafbdc8, NAME => 'hbase:namespace,,1689311516836.437edc714ffa0d0a6cb653095eafbdc8.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp 2023-07-14 05:11:56,954 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689311516836.437edc714ffa0d0a6cb653095eafbdc8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 05:11:56,955 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 437edc714ffa0d0a6cb653095eafbdc8, disabling compactions & flushes 2023-07-14 05:11:56,955 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689311516836.437edc714ffa0d0a6cb653095eafbdc8. 2023-07-14 05:11:56,955 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689311516836.437edc714ffa0d0a6cb653095eafbdc8. 2023-07-14 05:11:56,955 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689311516836.437edc714ffa0d0a6cb653095eafbdc8. after waiting 0 ms 2023-07-14 05:11:56,955 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689311516836.437edc714ffa0d0a6cb653095eafbdc8. 2023-07-14 05:11:56,955 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689311516836.437edc714ffa0d0a6cb653095eafbdc8. 2023-07-14 05:11:56,955 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 437edc714ffa0d0a6cb653095eafbdc8: 2023-07-14 05:11:56,960 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 05:11:56,981 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689311516836.437edc714ffa0d0a6cb653095eafbdc8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689311516964"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689311516964"}]},"ts":"1689311516964"} 2023-07-14 05:11:57,019 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-14 05:11:57,021 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 05:11:57,026 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689311517021"}]},"ts":"1689311517021"} 2023-07-14 05:11:57,032 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-14 05:11:57,037 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-14 05:11:57,038 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 05:11:57,038 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 05:11:57,038 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 05:11:57,038 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 05:11:57,041 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=437edc714ffa0d0a6cb653095eafbdc8, ASSIGN}] 2023-07-14 05:11:57,044 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=437edc714ffa0d0a6cb653095eafbdc8, ASSIGN 2023-07-14 05:11:57,046 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=437edc714ffa0d0a6cb653095eafbdc8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35487,1689311513755; forceNewPlan=false, retain=false 2023-07-14 05:11:57,199 INFO [jenkins-hbase4:35845] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-14 05:11:57,200 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=437edc714ffa0d0a6cb653095eafbdc8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:11:57,201 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689311516836.437edc714ffa0d0a6cb653095eafbdc8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689311517200"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689311517200"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689311517200"}]},"ts":"1689311517200"} 2023-07-14 05:11:57,207 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 437edc714ffa0d0a6cb653095eafbdc8, server=jenkins-hbase4.apache.org,35487,1689311513755}] 2023-07-14 05:11:57,363 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:11:57,363 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-14 05:11:57,366 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43738, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-14 05:11:57,373 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689311516836.437edc714ffa0d0a6cb653095eafbdc8. 2023-07-14 05:11:57,373 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 437edc714ffa0d0a6cb653095eafbdc8, NAME => 'hbase:namespace,,1689311516836.437edc714ffa0d0a6cb653095eafbdc8.', STARTKEY => '', ENDKEY => ''} 2023-07-14 05:11:57,373 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689311516836.437edc714ffa0d0a6cb653095eafbdc8. service=AccessControlService 2023-07-14 05:11:57,374 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 05:11:57,374 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 437edc714ffa0d0a6cb653095eafbdc8 2023-07-14 05:11:57,375 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689311516836.437edc714ffa0d0a6cb653095eafbdc8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 05:11:57,375 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 437edc714ffa0d0a6cb653095eafbdc8 2023-07-14 05:11:57,375 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 437edc714ffa0d0a6cb653095eafbdc8 2023-07-14 05:11:57,377 INFO [StoreOpener-437edc714ffa0d0a6cb653095eafbdc8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 437edc714ffa0d0a6cb653095eafbdc8 2023-07-14 05:11:57,380 DEBUG [StoreOpener-437edc714ffa0d0a6cb653095eafbdc8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/hbase/namespace/437edc714ffa0d0a6cb653095eafbdc8/info 2023-07-14 05:11:57,380 DEBUG [StoreOpener-437edc714ffa0d0a6cb653095eafbdc8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/hbase/namespace/437edc714ffa0d0a6cb653095eafbdc8/info 2023-07-14 05:11:57,380 INFO [StoreOpener-437edc714ffa0d0a6cb653095eafbdc8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 437edc714ffa0d0a6cb653095eafbdc8 columnFamilyName info 2023-07-14 05:11:57,381 INFO [StoreOpener-437edc714ffa0d0a6cb653095eafbdc8-1] regionserver.HStore(310): Store=437edc714ffa0d0a6cb653095eafbdc8/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 05:11:57,383 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/hbase/namespace/437edc714ffa0d0a6cb653095eafbdc8 2023-07-14 05:11:57,384 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/hbase/namespace/437edc714ffa0d0a6cb653095eafbdc8 2023-07-14 05:11:57,388 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 437edc714ffa0d0a6cb653095eafbdc8 2023-07-14 05:11:57,391 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/hbase/namespace/437edc714ffa0d0a6cb653095eafbdc8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 05:11:57,392 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 437edc714ffa0d0a6cb653095eafbdc8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67437612, jitterRate=0.004898726940155029}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 05:11:57,392 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 437edc714ffa0d0a6cb653095eafbdc8: 2023-07-14 05:11:57,394 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689311516836.437edc714ffa0d0a6cb653095eafbdc8., pid=6, masterSystemTime=1689311517363 2023-07-14 05:11:57,399 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689311516836.437edc714ffa0d0a6cb653095eafbdc8. 2023-07-14 05:11:57,399 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689311516836.437edc714ffa0d0a6cb653095eafbdc8. 2023-07-14 05:11:57,401 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=437edc714ffa0d0a6cb653095eafbdc8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:11:57,401 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689311516836.437edc714ffa0d0a6cb653095eafbdc8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689311517400"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689311517400"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689311517400"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689311517400"}]},"ts":"1689311517400"} 2023-07-14 05:11:57,408 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-14 05:11:57,408 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 437edc714ffa0d0a6cb653095eafbdc8, server=jenkins-hbase4.apache.org,35487,1689311513755 in 197 msec 2023-07-14 05:11:57,412 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-14 05:11:57,413 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=437edc714ffa0d0a6cb653095eafbdc8, ASSIGN in 367 msec 2023-07-14 05:11:57,414 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 05:11:57,414 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689311517414"}]},"ts":"1689311517414"} 2023-07-14 05:11:57,416 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-14 05:11:57,420 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 05:11:57,423 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 582 msec 2023-07-14 05:11:57,452 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-14 05:11:57,455 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-14 05:11:57,455 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 05:11:57,480 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 05:11:57,483 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43754, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 05:11:57,496 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-14 05:11:57,511 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-14 05:11:57,517 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 27 msec 2023-07-14 05:11:57,529 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-14 05:11:57,539 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-14 05:11:57,545 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 15 msec 2023-07-14 05:11:57,554 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-14 05:11:57,558 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-14 05:11:57,558 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.567sec 2023-07-14 05:11:57,562 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-14 05:11:57,564 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-14 05:11:57,564 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-14 05:11:57,566 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35845,1689311512312-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-14 05:11:57,566 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35845,1689311512312-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-14 05:11:57,588 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-14 05:11:57,590 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-14 05:11:57,592 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 05:11:57,593 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 05:11:57,596 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/hbase/acl/2c094c58ae2cbbe49d97110c24d96ef4 2023-07-14 05:11:57,596 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-14 05:11:57,597 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/hbase/acl/2c094c58ae2cbbe49d97110c24d96ef4 empty. 2023-07-14 05:11:57,599 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/hbase/acl/2c094c58ae2cbbe49d97110c24d96ef4 2023-07-14 05:11:57,599 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-14 05:11:57,603 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-14 05:11:57,626 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-14 05:11:57,629 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2c094c58ae2cbbe49d97110c24d96ef4, NAME => 'hbase:acl,,1689311517584.2c094c58ae2cbbe49d97110c24d96ef4.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp 2023-07-14 05:11:57,646 DEBUG [Listener at localhost/35767] zookeeper.ReadOnlyZKClient(139): Connect 0x7b4bf029 to 127.0.0.1:55310 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 05:11:57,659 DEBUG [Listener at localhost/35767] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1370d70b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 05:11:57,659 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689311517584.2c094c58ae2cbbe49d97110c24d96ef4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 05:11:57,660 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 2c094c58ae2cbbe49d97110c24d96ef4, disabling compactions & flushes 2023-07-14 05:11:57,660 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689311517584.2c094c58ae2cbbe49d97110c24d96ef4. 2023-07-14 05:11:57,660 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689311517584.2c094c58ae2cbbe49d97110c24d96ef4. 2023-07-14 05:11:57,660 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689311517584.2c094c58ae2cbbe49d97110c24d96ef4. after waiting 0 ms 2023-07-14 05:11:57,660 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689311517584.2c094c58ae2cbbe49d97110c24d96ef4. 2023-07-14 05:11:57,660 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689311517584.2c094c58ae2cbbe49d97110c24d96ef4. 2023-07-14 05:11:57,660 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 2c094c58ae2cbbe49d97110c24d96ef4: 2023-07-14 05:11:57,668 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 05:11:57,670 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689311517584.2c094c58ae2cbbe49d97110c24d96ef4.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689311517670"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689311517670"}]},"ts":"1689311517670"} 2023-07-14 05:11:57,674 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-14 05:11:57,676 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 05:11:57,677 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689311517677"}]},"ts":"1689311517677"} 2023-07-14 05:11:57,678 DEBUG [hconnection-0x226ad64-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 05:11:57,680 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-14 05:11:57,689 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-14 05:11:57,690 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 05:11:57,690 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 05:11:57,690 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 05:11:57,690 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 05:11:57,691 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=2c094c58ae2cbbe49d97110c24d96ef4, ASSIGN}] 2023-07-14 05:11:57,694 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=2c094c58ae2cbbe49d97110c24d96ef4, ASSIGN 2023-07-14 05:11:57,696 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=2c094c58ae2cbbe49d97110c24d96ef4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35487,1689311513755; forceNewPlan=false, retain=false 2023-07-14 05:11:57,696 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36856, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 05:11:57,699 INFO [Listener at localhost/35767] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,35845,1689311512312 2023-07-14 05:11:57,699 INFO [Listener at localhost/35767] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-14 05:11:57,699 INFO [Listener at localhost/35767] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/test.cache.data in system properties and HBase conf 2023-07-14 05:11:57,699 INFO [Listener at localhost/35767] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/hadoop.tmp.dir in system properties and HBase conf 2023-07-14 05:11:57,699 INFO [Listener at localhost/35767] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/hadoop.log.dir in system properties and HBase conf 2023-07-14 05:11:57,699 INFO [Listener at localhost/35767] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-14 05:11:57,699 INFO [Listener at localhost/35767] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-14 05:11:57,699 INFO [Listener at localhost/35767] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-14 05:11:57,699 INFO [Listener at localhost/35767] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-14 05:11:57,699 INFO [Listener at localhost/35767] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-14 05:11:57,700 INFO [Listener at localhost/35767] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-14 05:11:57,700 INFO [Listener at localhost/35767] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-14 05:11:57,700 INFO [Listener at localhost/35767] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-14 05:11:57,700 INFO [Listener at localhost/35767] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-14 05:11:57,700 INFO [Listener at localhost/35767] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-14 05:11:57,700 INFO [Listener at localhost/35767] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-14 05:11:57,700 INFO [Listener at localhost/35767] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-14 05:11:57,700 INFO [Listener at localhost/35767] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/nfs.dump.dir in system properties and HBase conf 2023-07-14 05:11:57,700 INFO [Listener at localhost/35767] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/java.io.tmpdir in system properties and HBase conf 2023-07-14 05:11:57,700 INFO [Listener at localhost/35767] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-14 05:11:57,700 INFO [Listener at localhost/35767] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-14 05:11:57,700 INFO [Listener at localhost/35767] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-14 05:11:57,707 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-14 05:11:57,846 INFO [jenkins-hbase4:35845] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-14 05:11:57,847 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=2c094c58ae2cbbe49d97110c24d96ef4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:11:57,848 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689311517584.2c094c58ae2cbbe49d97110c24d96ef4.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689311517847"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689311517847"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689311517847"}]},"ts":"1689311517847"} 2023-07-14 05:11:57,853 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 2c094c58ae2cbbe49d97110c24d96ef4, server=jenkins-hbase4.apache.org,35487,1689311513755}] 2023-07-14 05:11:57,908 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-14 05:11:58,020 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689311517584.2c094c58ae2cbbe49d97110c24d96ef4. 2023-07-14 05:11:58,021 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2c094c58ae2cbbe49d97110c24d96ef4, NAME => 'hbase:acl,,1689311517584.2c094c58ae2cbbe49d97110c24d96ef4.', STARTKEY => '', ENDKEY => ''} 2023-07-14 05:11:58,021 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689311517584.2c094c58ae2cbbe49d97110c24d96ef4. service=AccessControlService 2023-07-14 05:11:58,021 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 05:11:58,021 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 2c094c58ae2cbbe49d97110c24d96ef4 2023-07-14 05:11:58,021 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689311517584.2c094c58ae2cbbe49d97110c24d96ef4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 05:11:58,022 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2c094c58ae2cbbe49d97110c24d96ef4 2023-07-14 05:11:58,022 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2c094c58ae2cbbe49d97110c24d96ef4 2023-07-14 05:11:58,024 INFO [StoreOpener-2c094c58ae2cbbe49d97110c24d96ef4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 2c094c58ae2cbbe49d97110c24d96ef4 2023-07-14 05:11:58,026 DEBUG [StoreOpener-2c094c58ae2cbbe49d97110c24d96ef4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/hbase/acl/2c094c58ae2cbbe49d97110c24d96ef4/l 2023-07-14 05:11:58,026 DEBUG [StoreOpener-2c094c58ae2cbbe49d97110c24d96ef4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/hbase/acl/2c094c58ae2cbbe49d97110c24d96ef4/l 2023-07-14 05:11:58,026 INFO [StoreOpener-2c094c58ae2cbbe49d97110c24d96ef4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2c094c58ae2cbbe49d97110c24d96ef4 columnFamilyName l 2023-07-14 05:11:58,027 INFO [StoreOpener-2c094c58ae2cbbe49d97110c24d96ef4-1] regionserver.HStore(310): Store=2c094c58ae2cbbe49d97110c24d96ef4/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 05:11:58,029 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/hbase/acl/2c094c58ae2cbbe49d97110c24d96ef4 2023-07-14 05:11:58,033 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/hbase/acl/2c094c58ae2cbbe49d97110c24d96ef4 2023-07-14 05:11:58,040 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2c094c58ae2cbbe49d97110c24d96ef4 2023-07-14 05:11:58,045 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/hbase/acl/2c094c58ae2cbbe49d97110c24d96ef4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 05:11:58,047 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2c094c58ae2cbbe49d97110c24d96ef4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67005405, jitterRate=-0.0015416592359542847}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 05:11:58,047 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2c094c58ae2cbbe49d97110c24d96ef4: 2023-07-14 05:11:58,049 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689311517584.2c094c58ae2cbbe49d97110c24d96ef4., pid=11, masterSystemTime=1689311518006 2023-07-14 05:11:58,053 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689311517584.2c094c58ae2cbbe49d97110c24d96ef4. 2023-07-14 05:11:58,053 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689311517584.2c094c58ae2cbbe49d97110c24d96ef4. 2023-07-14 05:11:58,054 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=2c094c58ae2cbbe49d97110c24d96ef4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:11:58,055 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689311517584.2c094c58ae2cbbe49d97110c24d96ef4.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689311518054"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689311518054"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689311518054"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689311518054"}]},"ts":"1689311518054"} 2023-07-14 05:11:58,066 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-14 05:11:58,066 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 2c094c58ae2cbbe49d97110c24d96ef4, server=jenkins-hbase4.apache.org,35487,1689311513755 in 206 msec 2023-07-14 05:11:58,070 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-14 05:11:58,070 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=2c094c58ae2cbbe49d97110c24d96ef4, ASSIGN in 375 msec 2023-07-14 05:11:58,071 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 05:11:58,072 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689311518071"}]},"ts":"1689311518071"} 2023-07-14 05:11:58,074 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-14 05:11:58,078 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 05:11:58,082 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 490 msec 2023-07-14 05:11:58,211 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-14 05:11:58,211 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-14 05:11:58,224 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-14 05:11:59,038 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 05:11:59,367 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 05:11:59,375 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_39455_jobhistory____jwmmvr/webapp 2023-07-14 05:11:59,540 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-14 05:11:59,540 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-14 05:11:59,540 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-14 05:11:59,543 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-14 05:11:59,616 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 05:11:59,912 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 05:12:00,232 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-14 05:12:00,284 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:39455 2023-07-14 05:12:00,547 WARN [Listener at jenkins-hbase4.apache.org/46397] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 05:12:00,966 WARN [Listener at jenkins-hbase4.apache.org/46397] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-14 05:12:00,967 INFO [Listener at jenkins-hbase4.apache.org/46397] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 05:12:00,979 INFO [Listener at jenkins-hbase4.apache.org/46397] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_42555_cluster____wcg6b1/webapp 2023-07-14 05:12:01,129 INFO [Listener at jenkins-hbase4.apache.org/46397] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-14 05:12:01,129 INFO [Listener at jenkins-hbase4.apache.org/46397] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-14 05:12:01,129 INFO [Listener at jenkins-hbase4.apache.org/46397] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-14 05:12:01,134 INFO [Listener at jenkins-hbase4.apache.org/46397] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-14 05:12:01,169 INFO [Listener at jenkins-hbase4.apache.org/46397] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 05:12:01,403 INFO [Listener at jenkins-hbase4.apache.org/46397] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 05:12:01,537 INFO [Listener at jenkins-hbase4.apache.org/46397] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 05:12:01,563 INFO [Listener at jenkins-hbase4.apache.org/46397] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:42555 2023-07-14 05:12:02,215 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 05:12:02,327 WARN [Listener at jenkins-hbase4.apache.org/46705] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 05:12:02,363 WARN [Listener at jenkins-hbase4.apache.org/46705] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-14 05:12:02,364 INFO [Listener at jenkins-hbase4.apache.org/46705] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 05:12:02,368 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-14 05:12:02,370 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-14 05:12:02,371 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-14 05:12:02,386 INFO [Listener at jenkins-hbase4.apache.org/46705] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_39527_node____.9ashim/webapp 2023-07-14 05:12:02,444 INFO [Listener at jenkins-hbase4.apache.org/46705] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-14 05:12:02,444 INFO [Listener at jenkins-hbase4.apache.org/46705] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-14 05:12:02,444 INFO [Listener at jenkins-hbase4.apache.org/46705] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-14 05:12:02,444 INFO [Listener at jenkins-hbase4.apache.org/46705] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-14 05:12:02,455 INFO [Listener at jenkins-hbase4.apache.org/46705] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 05:12:02,481 INFO [Listener at jenkins-hbase4.apache.org/46705] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 05:12:02,494 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 05:12:02,495 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-14 05:12:02,495 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 05:12:02,495 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-14 05:12:02,495 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-14 05:12:02,496 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-14 05:12:02,496 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 05:12:02,496 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-14 05:12:02,496 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-14 05:12:02,496 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-14 05:12:02,581 INFO [Listener at jenkins-hbase4.apache.org/46705] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 05:12:02,594 INFO [Listener at jenkins-hbase4.apache.org/46705] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:39527 2023-07-14 05:12:02,981 WARN [Listener at jenkins-hbase4.apache.org/38651] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 05:12:02,989 WARN [Listener at jenkins-hbase4.apache.org/38651] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-14 05:12:02,989 INFO [Listener at jenkins-hbase4.apache.org/38651] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 05:12:02,997 INFO [Listener at jenkins-hbase4.apache.org/38651] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_45979_node____.4i77yg/webapp 2023-07-14 05:12:03,059 INFO [Listener at jenkins-hbase4.apache.org/38651] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-14 05:12:03,059 INFO [Listener at jenkins-hbase4.apache.org/38651] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-14 05:12:03,060 INFO [Listener at jenkins-hbase4.apache.org/38651] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-14 05:12:03,060 INFO [Listener at jenkins-hbase4.apache.org/38651] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-14 05:12:03,070 INFO [Listener at jenkins-hbase4.apache.org/38651] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 05:12:03,084 INFO [Listener at jenkins-hbase4.apache.org/38651] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 05:12:03,157 INFO [Listener at jenkins-hbase4.apache.org/38651] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 05:12:03,167 INFO [Listener at jenkins-hbase4.apache.org/38651] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:45979 2023-07-14 05:12:03,191 INFO [Listener at jenkins-hbase4.apache.org/38651] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-14 05:12:03,193 INFO [Listener at jenkins-hbase4.apache.org/38651] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 05:12:03,267 INFO [Listener at jenkins-hbase4.apache.org/38651] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=708, OpenFileDescriptor=898, MaxFileDescriptor=60000, SystemLoadAverage=306, ProcessCount=175, AvailableMemoryMB=5753 2023-07-14 05:12:03,267 WARN [Listener at jenkins-hbase4.apache.org/38651] hbase.ResourceChecker(130): Thread=708 is superior to 500 2023-07-14 05:12:03,284 DEBUG [Listener at jenkins-hbase4.apache.org/38651] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-14 05:12:03,291 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41508, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-14 05:12:03,298 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-14 05:12:03,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-14 05:12:03,304 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 05:12:03,304 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-14 05:12:03,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-14 05:12:03,307 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 05:12:03,312 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportWithTargetName/8908752b8022f31f3c456e1893d0818e 2023-07-14 05:12:03,312 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportWithTargetName/08b97c02ecbc544fe8eaaf0b3b4fd37c 2023-07-14 05:12:03,313 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportWithTargetName/8908752b8022f31f3c456e1893d0818e empty. 2023-07-14 05:12:03,315 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportWithTargetName/08b97c02ecbc544fe8eaaf0b3b4fd37c empty. 2023-07-14 05:12:03,316 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportWithTargetName/8908752b8022f31f3c456e1893d0818e 2023-07-14 05:12:03,316 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportWithTargetName/08b97c02ecbc544fe8eaaf0b3b4fd37c 2023-07-14 05:12:03,316 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-14 05:12:03,346 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-14 05:12:03,347 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8908752b8022f31f3c456e1893d0818e, NAME => 'testtb-testExportWithTargetName,,1689311523298.8908752b8022f31f3c456e1893d0818e.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp 2023-07-14 05:12:03,348 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 08b97c02ecbc544fe8eaaf0b3b4fd37c, NAME => 'testtb-testExportWithTargetName,1,1689311523298.08b97c02ecbc544fe8eaaf0b3b4fd37c.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp 2023-07-14 05:12:03,396 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689311523298.08b97c02ecbc544fe8eaaf0b3b4fd37c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 05:12:03,396 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 08b97c02ecbc544fe8eaaf0b3b4fd37c, disabling compactions & flushes 2023-07-14 05:12:03,397 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689311523298.08b97c02ecbc544fe8eaaf0b3b4fd37c. 2023-07-14 05:12:03,397 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689311523298.08b97c02ecbc544fe8eaaf0b3b4fd37c. 2023-07-14 05:12:03,397 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689311523298.08b97c02ecbc544fe8eaaf0b3b4fd37c. after waiting 0 ms 2023-07-14 05:12:03,397 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689311523298.08b97c02ecbc544fe8eaaf0b3b4fd37c. 2023-07-14 05:12:03,397 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689311523298.08b97c02ecbc544fe8eaaf0b3b4fd37c. 2023-07-14 05:12:03,397 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 08b97c02ecbc544fe8eaaf0b3b4fd37c: 2023-07-14 05:12:03,405 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689311523298.8908752b8022f31f3c456e1893d0818e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 05:12:03,406 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 8908752b8022f31f3c456e1893d0818e, disabling compactions & flushes 2023-07-14 05:12:03,406 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689311523298.8908752b8022f31f3c456e1893d0818e. 2023-07-14 05:12:03,406 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689311523298.8908752b8022f31f3c456e1893d0818e. 2023-07-14 05:12:03,406 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689311523298.8908752b8022f31f3c456e1893d0818e. after waiting 0 ms 2023-07-14 05:12:03,406 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689311523298.8908752b8022f31f3c456e1893d0818e. 2023-07-14 05:12:03,406 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689311523298.8908752b8022f31f3c456e1893d0818e. 2023-07-14 05:12:03,406 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 8908752b8022f31f3c456e1893d0818e: 2023-07-14 05:12:03,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-14 05:12:03,410 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 05:12:03,412 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689311523298.08b97c02ecbc544fe8eaaf0b3b4fd37c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689311523412"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689311523412"}]},"ts":"1689311523412"} 2023-07-14 05:12:03,412 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689311523298.8908752b8022f31f3c456e1893d0818e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689311523412"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689311523412"}]},"ts":"1689311523412"} 2023-07-14 05:12:03,465 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 05:12:03,466 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 05:12:03,467 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689311523466"}]},"ts":"1689311523466"} 2023-07-14 05:12:03,471 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-14 05:12:03,477 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-14 05:12:03,479 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 05:12:03,479 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 05:12:03,479 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 05:12:03,480 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 05:12:03,480 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8908752b8022f31f3c456e1893d0818e, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=08b97c02ecbc544fe8eaaf0b3b4fd37c, ASSIGN}] 2023-07-14 05:12:03,483 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=08b97c02ecbc544fe8eaaf0b3b4fd37c, ASSIGN 2023-07-14 05:12:03,483 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8908752b8022f31f3c456e1893d0818e, ASSIGN 2023-07-14 05:12:03,485 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=08b97c02ecbc544fe8eaaf0b3b4fd37c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43331,1689311513888; forceNewPlan=false, retain=false 2023-07-14 05:12:03,485 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8908752b8022f31f3c456e1893d0818e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35487,1689311513755; forceNewPlan=false, retain=false 2023-07-14 05:12:03,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-14 05:12:03,635 INFO [jenkins-hbase4:35845] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 05:12:03,638 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=08b97c02ecbc544fe8eaaf0b3b4fd37c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:03,638 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=8908752b8022f31f3c456e1893d0818e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:03,638 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689311523298.08b97c02ecbc544fe8eaaf0b3b4fd37c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689311523638"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689311523638"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689311523638"}]},"ts":"1689311523638"} 2023-07-14 05:12:03,638 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689311523298.8908752b8022f31f3c456e1893d0818e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689311523638"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689311523638"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689311523638"}]},"ts":"1689311523638"} 2023-07-14 05:12:03,641 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 08b97c02ecbc544fe8eaaf0b3b4fd37c, server=jenkins-hbase4.apache.org,43331,1689311513888}] 2023-07-14 05:12:03,643 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 8908752b8022f31f3c456e1893d0818e, server=jenkins-hbase4.apache.org,35487,1689311513755}] 2023-07-14 05:12:03,803 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689311523298.08b97c02ecbc544fe8eaaf0b3b4fd37c. 2023-07-14 05:12:03,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 08b97c02ecbc544fe8eaaf0b3b4fd37c, NAME => 'testtb-testExportWithTargetName,1,1689311523298.08b97c02ecbc544fe8eaaf0b3b4fd37c.', STARTKEY => '1', ENDKEY => ''} 2023-07-14 05:12:03,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689311523298.08b97c02ecbc544fe8eaaf0b3b4fd37c. service=AccessControlService 2023-07-14 05:12:03,804 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 05:12:03,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 08b97c02ecbc544fe8eaaf0b3b4fd37c 2023-07-14 05:12:03,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689311523298.08b97c02ecbc544fe8eaaf0b3b4fd37c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 05:12:03,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 08b97c02ecbc544fe8eaaf0b3b4fd37c 2023-07-14 05:12:03,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 08b97c02ecbc544fe8eaaf0b3b4fd37c 2023-07-14 05:12:03,810 INFO [StoreOpener-08b97c02ecbc544fe8eaaf0b3b4fd37c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 08b97c02ecbc544fe8eaaf0b3b4fd37c 2023-07-14 05:12:03,810 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689311523298.8908752b8022f31f3c456e1893d0818e. 2023-07-14 05:12:03,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8908752b8022f31f3c456e1893d0818e, NAME => 'testtb-testExportWithTargetName,,1689311523298.8908752b8022f31f3c456e1893d0818e.', STARTKEY => '', ENDKEY => '1'} 2023-07-14 05:12:03,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689311523298.8908752b8022f31f3c456e1893d0818e. service=AccessControlService 2023-07-14 05:12:03,811 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 05:12:03,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 8908752b8022f31f3c456e1893d0818e 2023-07-14 05:12:03,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689311523298.8908752b8022f31f3c456e1893d0818e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 05:12:03,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8908752b8022f31f3c456e1893d0818e 2023-07-14 05:12:03,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8908752b8022f31f3c456e1893d0818e 2023-07-14 05:12:03,812 DEBUG [StoreOpener-08b97c02ecbc544fe8eaaf0b3b4fd37c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportWithTargetName/08b97c02ecbc544fe8eaaf0b3b4fd37c/cf 2023-07-14 05:12:03,812 DEBUG [StoreOpener-08b97c02ecbc544fe8eaaf0b3b4fd37c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportWithTargetName/08b97c02ecbc544fe8eaaf0b3b4fd37c/cf 2023-07-14 05:12:03,813 INFO [StoreOpener-08b97c02ecbc544fe8eaaf0b3b4fd37c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 08b97c02ecbc544fe8eaaf0b3b4fd37c columnFamilyName cf 2023-07-14 05:12:03,814 INFO [StoreOpener-08b97c02ecbc544fe8eaaf0b3b4fd37c-1] regionserver.HStore(310): Store=08b97c02ecbc544fe8eaaf0b3b4fd37c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 05:12:03,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportWithTargetName/08b97c02ecbc544fe8eaaf0b3b4fd37c 2023-07-14 05:12:03,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportWithTargetName/08b97c02ecbc544fe8eaaf0b3b4fd37c 2023-07-14 05:12:03,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 08b97c02ecbc544fe8eaaf0b3b4fd37c 2023-07-14 05:12:03,823 INFO [StoreOpener-8908752b8022f31f3c456e1893d0818e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8908752b8022f31f3c456e1893d0818e 2023-07-14 05:12:03,825 DEBUG [StoreOpener-8908752b8022f31f3c456e1893d0818e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportWithTargetName/8908752b8022f31f3c456e1893d0818e/cf 2023-07-14 05:12:03,825 DEBUG [StoreOpener-8908752b8022f31f3c456e1893d0818e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportWithTargetName/8908752b8022f31f3c456e1893d0818e/cf 2023-07-14 05:12:03,826 INFO [StoreOpener-8908752b8022f31f3c456e1893d0818e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8908752b8022f31f3c456e1893d0818e columnFamilyName cf 2023-07-14 05:12:03,826 INFO [StoreOpener-8908752b8022f31f3c456e1893d0818e-1] regionserver.HStore(310): Store=8908752b8022f31f3c456e1893d0818e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 05:12:03,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportWithTargetName/08b97c02ecbc544fe8eaaf0b3b4fd37c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 05:12:03,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportWithTargetName/8908752b8022f31f3c456e1893d0818e 2023-07-14 05:12:03,832 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 08b97c02ecbc544fe8eaaf0b3b4fd37c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74338066, jitterRate=0.10772350430488586}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 05:12:03,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 08b97c02ecbc544fe8eaaf0b3b4fd37c: 2023-07-14 05:12:03,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportWithTargetName/8908752b8022f31f3c456e1893d0818e 2023-07-14 05:12:03,834 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689311523298.08b97c02ecbc544fe8eaaf0b3b4fd37c., pid=15, masterSystemTime=1689311523795 2023-07-14 05:12:03,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689311523298.08b97c02ecbc544fe8eaaf0b3b4fd37c. 2023-07-14 05:12:03,837 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689311523298.08b97c02ecbc544fe8eaaf0b3b4fd37c. 2023-07-14 05:12:03,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8908752b8022f31f3c456e1893d0818e 2023-07-14 05:12:03,838 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=08b97c02ecbc544fe8eaaf0b3b4fd37c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:03,838 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689311523298.08b97c02ecbc544fe8eaaf0b3b4fd37c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689311523838"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689311523838"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689311523838"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689311523838"}]},"ts":"1689311523838"} 2023-07-14 05:12:03,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportWithTargetName/8908752b8022f31f3c456e1893d0818e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 05:12:03,843 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8908752b8022f31f3c456e1893d0818e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64206113, jitterRate=-0.04325436055660248}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 05:12:03,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8908752b8022f31f3c456e1893d0818e: 2023-07-14 05:12:03,845 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689311523298.8908752b8022f31f3c456e1893d0818e., pid=16, masterSystemTime=1689311523796 2023-07-14 05:12:03,845 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-14 05:12:03,846 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 08b97c02ecbc544fe8eaaf0b3b4fd37c, server=jenkins-hbase4.apache.org,43331,1689311513888 in 200 msec 2023-07-14 05:12:03,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689311523298.8908752b8022f31f3c456e1893d0818e. 2023-07-14 05:12:03,848 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689311523298.8908752b8022f31f3c456e1893d0818e. 2023-07-14 05:12:03,849 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=08b97c02ecbc544fe8eaaf0b3b4fd37c, ASSIGN in 365 msec 2023-07-14 05:12:03,849 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=8908752b8022f31f3c456e1893d0818e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:03,850 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689311523298.8908752b8022f31f3c456e1893d0818e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689311523849"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689311523849"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689311523849"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689311523849"}]},"ts":"1689311523849"} 2023-07-14 05:12:03,855 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-14 05:12:03,855 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 8908752b8022f31f3c456e1893d0818e, server=jenkins-hbase4.apache.org,35487,1689311513755 in 209 msec 2023-07-14 05:12:03,858 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-14 05:12:03,861 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8908752b8022f31f3c456e1893d0818e, ASSIGN in 375 msec 2023-07-14 05:12:03,862 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 05:12:03,863 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689311523863"}]},"ts":"1689311523863"} 2023-07-14 05:12:03,865 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-14 05:12:03,868 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 05:12:03,873 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-14 05:12:03,882 DEBUG [hconnection-0x7d25120b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 05:12:03,883 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50526, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=ClientService 2023-07-14 05:12:03,891 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35487] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-14 05:12:03,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-14 05:12:03,922 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-14 05:12:03,922 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-14 05:12:03,922 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-14 05:12:03,922 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-14 05:12:03,922 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 05:12:03,931 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-14 05:12:03,931 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-14 05:12:03,931 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-14 05:12:03,932 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-14 05:12:03,933 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-14 05:12:03,934 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-14 05:12:03,936 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 634 msec 2023-07-14 05:12:03,939 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-14 05:12:04,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-14 05:12:04,414 INFO [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-14 05:12:04,414 DEBUG [Listener at jenkins-hbase4.apache.org/38651] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportWithTargetName get assigned. Timeout = 60000ms 2023-07-14 05:12:04,415 INFO [Listener at jenkins-hbase4.apache.org/38651] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 05:12:04,419 INFO [Listener at jenkins-hbase4.apache.org/38651] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportWithTargetName assigned to meta. Checking AM states. 2023-07-14 05:12:04,420 INFO [Listener at jenkins-hbase4.apache.org/38651] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 05:12:04,420 INFO [Listener at jenkins-hbase4.apache.org/38651] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportWithTargetName assigned. 2023-07-14 05:12:04,434 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-14 05:12:04,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689311524435 (current time:1689311524435). 2023-07-14 05:12:04,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 05:12:04,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] zookeeper.ReadOnlyZKClient(139): Connect 0x5381ac43 to 127.0.0.1:55310 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 05:12:04,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@63216c6e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 05:12:04,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 05:12:04,445 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50532, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 05:12:04,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5381ac43 to 127.0.0.1:55310 2023-07-14 05:12:04,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 05:12:04,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] zookeeper.ReadOnlyZKClient(139): Connect 0x36d8d9d4 to 127.0.0.1:55310 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 05:12:04,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@47330af, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 05:12:04,456 DEBUG [hconnection-0xcd7811d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 05:12:04,458 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50546, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 05:12:04,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 05:12:04,463 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51260, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 05:12:04,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x36d8d9d4 to 127.0.0.1:55310 2023-07-14 05:12:04,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 05:12:04,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-14 05:12:04,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 05:12:04,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-14 05:12:04,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-14 05:12:04,507 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-14 05:12:04,508 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689312124508 2023-07-14 05:12:04,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-14 05:12:04,508 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-14 05:12:04,511 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-14 05:12:04,512 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-14 05:12:04,513 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 13 msec 2023-07-14 05:12:04,514 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-14 05:12:04,515 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689312124515 2023-07-14 05:12:04,515 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 05:12:04,515 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 05:12:04,535 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,535 INFO [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-14 05:12:04,536 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 05:12:04,536 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-14 05:12:04,536 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-14 05:12:04,537 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,537 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,542 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:12:04,542 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:12:04,542 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:04,542 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:12:04,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:12:04,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:12:04,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:12:04,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:12:04,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:12:04,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:12:04,543 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:04,543 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:04,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,544 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:04,544 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 05:12:04,544 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,544 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,544 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-14 05:12:04,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-14 05:12:04,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-14 05:12:04,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,545 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-14 05:12:04,545 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-14 05:12:04,545 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-14 05:12:04,547 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,547 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,547 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,547 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-14 05:12:04,547 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 05:12:04,547 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-14 05:12:04,548 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-14 05:12:04,548 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 05:12:04,548 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-14 05:12:04,549 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-14 05:12:04,549 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-14 05:12:04,549 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-14 05:12:04,549 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35487,1689311513755' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-14 05:12:04,548 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 05:12:04,549 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35535,1689311513825' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-14 05:12:04,550 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-14 05:12:04,550 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-14 05:12:04,550 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43331,1689311513888' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-14 05:12:04,553 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,553 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,553 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:04,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:04,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:12:04,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:12:04,554 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,554 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:04,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:12:04,555 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,555 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 05:12:04,555 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,555 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 05:12:04,555 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,555 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 05:12:04,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:12:04,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:04,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:04,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:04,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:12:04,558 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35487,1689311513755' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-14 05:12:04,558 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d6d496[Count = 1] remaining members to acquire global barrier 2023-07-14 05:12:04,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:04,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:12:04,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:12:04,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:12:04,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:12:04,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:04,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:04,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:04,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:12:04,562 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43331,1689311513888' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-14 05:12:04,562 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d6d496[Count = 0] remaining members to acquire global barrier 2023-07-14 05:12:04,562 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-14 05:12:04,563 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,565 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,565 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,566 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-14 05:12:04,566 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-14 05:12:04,566 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-14 05:12:04,565 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,566 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:04,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,566 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35535,1689311513825' in zk 2023-07-14 05:12:04,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,566 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-14 05:12:04,566 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:04,566 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 05:12:04,570 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 05:12:04,571 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689311523298.08b97c02ecbc544fe8eaaf0b3b4fd37c. 2023-07-14 05:12:04,571 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 05:12:04,571 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689311523298.08b97c02ecbc544fe8eaaf0b3b4fd37c. started... 2023-07-14 05:12:04,576 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 05:12:04,576 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689311523298.8908752b8022f31f3c456e1893d0818e. 2023-07-14 05:12:04,576 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 05:12:04,576 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-14 05:12:04,576 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 05:12:04,577 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-14 05:12:04,579 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 08b97c02ecbc544fe8eaaf0b3b4fd37c: 2023-07-14 05:12:04,580 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689311523298.08b97c02ecbc544fe8eaaf0b3b4fd37c.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,576 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689311523298.8908752b8022f31f3c456e1893d0818e. started... 2023-07-14 05:12:04,584 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8908752b8022f31f3c456e1893d0818e: 2023-07-14 05:12:04,586 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689311523298.8908752b8022f31f3c456e1893d0818e.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,589 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 05:12:04,590 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 05:12:04,594 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 05:12:04,594 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 05:12:04,618 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 05:12:04,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 05:12:04,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-14 05:12:04,626 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 05:12:04,664 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689311523298.8908752b8022f31f3c456e1893d0818e. completed. 2023-07-14 05:12:04,664 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689311523298.8908752b8022f31f3c456e1893d0818e. 2023-07-14 05:12:04,665 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 05:12:04,665 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 05:12:04,665 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:04,665 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689311523298.08b97c02ecbc544fe8eaaf0b3b4fd37c. completed. 2023-07-14 05:12:04,665 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-14 05:12:04,665 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689311523298.08b97c02ecbc544fe8eaaf0b3b4fd37c. 2023-07-14 05:12:04,665 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35487,1689311513755' in zk 2023-07-14 05:12:04,665 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 05:12:04,665 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 05:12:04,665 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:04,666 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-14 05:12:04,666 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43331,1689311513888' in zk 2023-07-14 05:12:04,667 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:04,667 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-14 05:12:04,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:04,667 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 05:12:04,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:12:04,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:12:04,667 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-14 05:12:04,669 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-14 05:12:04,669 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 05:12:04,669 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-14 05:12:04,669 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:04,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:12:04,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:12:04,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:04,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:04,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:04,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:12:04,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:04,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:04,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:04,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,35487,1689311513755': 2023-07-14 05:12:04,678 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35487,1689311513755' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-14 05:12:04,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:04,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:12:04,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:12:04,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:12:04,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:12:04,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:04,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:04,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:04,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:12:04,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:04,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:04,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:04,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,43331,1689311513888': 2023-07-14 05:12:04,684 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43331,1689311513888' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-14 05:12:04,684 INFO [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-14 05:12:04,684 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 05:12:04,684 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 05:12:04,684 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,684 INFO [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 05:12:04,691 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,691 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,692 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,691 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,692 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:12:04,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,691 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:12:04,691 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:12:04,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:12:04,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:12:04,692 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:04,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:12:04,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:12:04,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:12:04,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:12:04,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:12:04,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:12:04,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,694 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:04,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:12:04,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,694 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:04,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:12:04,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:04,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:04,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:04,699 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:04,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:12:04,699 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:04,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,700 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:04,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:04,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:04,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:04,715 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:12:04,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:12:04,715 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:04,715 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:12:04,715 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:12:04,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:12:04,715 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:12:04,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:12:04,715 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:12:04,715 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:12:04,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:12:04,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:12:04,715 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:12:04,716 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:04,716 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:04,716 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,716 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:04,716 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,716 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:04,716 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:04,716 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,716 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,722 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 05:12:04,722 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:12:04,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:12:04,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:12:04,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:12:04,723 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:12:04,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:12:04,727 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,771 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,826 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 05:12:04,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 05:12:04,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-14 05:12:04,829 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 05:12:04,873 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-14 05:12:04,874 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,874 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:04,875 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689311524508Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689311524723 (+215 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689311524724 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689311524738 (+14 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689311524757 (+19 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689311524873 (+116 ms) 2023-07-14 05:12:04,877 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-14 05:12:04,880 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 367 msec 2023-07-14 05:12:05,129 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 05:12:05,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 05:12:05,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 05:12:05,153 DEBUG [htable-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 05:12:05,159 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51266, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 05:12:05,160 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35487] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689311523298.8908752b8022f31f3c456e1893d0818e. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 05:12:05,160 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43331] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689311523298.08b97c02ecbc544fe8eaaf0b3b4fd37c. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 05:12:05,166 DEBUG [Listener at jenkins-hbase4.apache.org/38651] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-14 05:12:05,168 DEBUG [Listener at jenkins-hbase4.apache.org/38651] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689311523298.8908752b8022f31f3c456e1893d0818e. 2023-07-14 05:12:05,170 INFO [Listener at jenkins-hbase4.apache.org/38651] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 05:12:05,206 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-14 05:12:05,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689311525206 (current time:1689311525206). 2023-07-14 05:12:05,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 05:12:05,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] zookeeper.ReadOnlyZKClient(139): Connect 0x5aed35da to 127.0.0.1:55310 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 05:12:05,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@630cbc60, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 05:12:05,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 05:12:05,220 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50550, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 05:12:05,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5aed35da to 127.0.0.1:55310 2023-07-14 05:12:05,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 05:12:05,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] zookeeper.ReadOnlyZKClient(139): Connect 0x3753bb03 to 127.0.0.1:55310 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 05:12:05,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4a30bd6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 05:12:05,229 DEBUG [hconnection-0x2ca589e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 05:12:05,231 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50560, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 05:12:05,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 05:12:05,237 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51280, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 05:12:05,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3753bb03 to 127.0.0.1:55310 2023-07-14 05:12:05,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 05:12:05,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-14 05:12:05,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 05:12:05,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-14 05:12:05,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-14 05:12:05,245 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-14 05:12:05,246 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689312125246 2023-07-14 05:12:05,246 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-14 05:12:05,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-14 05:12:05,247 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 05:12:05,247 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 05:12:05,248 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-14 05:12:05,248 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-14 05:12:05,250 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 6 msec 2023-07-14 05:12:05,251 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-14 05:12:05,252 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689312125252 2023-07-14 05:12:05,276 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-14 05:12:05,276 INFO [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-14 05:12:05,276 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 05:12:05,278 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-14 05:12:05,278 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-14 05:12:05,342 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 05:12:05,342 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 05:12:05,344 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:12:05,344 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:12:05,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:12:05,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:12:05,344 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:12:05,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:12:05,344 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:05,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:12:05,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:12:05,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:12:05,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 05:12:05,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 05:12:05,345 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:05,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 05:12:05,345 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:05,345 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 05:12:05,345 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 05:12:05,345 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 05:12:05,345 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:05,345 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 05:12:05,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-14 05:12:05,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 05:12:05,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-14 05:12:05,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 05:12:05,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-14 05:12:05,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 05:12:05,346 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-14 05:12:05,346 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-14 05:12:05,346 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-14 05:12:05,346 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-14 05:12:05,346 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-14 05:12:05,346 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-14 05:12:05,346 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-14 05:12:05,346 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 05:12:05,346 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-14 05:12:05,347 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-14 05:12:05,348 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-14 05:12:05,348 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 05:12:05,347 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 05:12:05,346 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 05:12:05,349 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-14 05:12:05,348 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-14 05:12:05,349 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43331,1689311513888' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-14 05:12:05,349 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-14 05:12:05,349 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35487,1689311513755' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-14 05:12:05,351 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-14 05:12:05,351 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-14 05:12:05,351 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35535,1689311513825' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-14 05:12:05,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 05:12:05,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-14 05:12:05,353 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 05:12:05,355 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 05:12:05,355 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:05,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:05,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:12:05,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:12:05,359 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:05,359 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 05:12:05,359 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 05:12:05,359 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 05:12:05,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:12:05,359 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 05:12:05,360 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 05:12:05,360 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 05:12:05,360 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 05:12:05,360 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 05:12:05,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:12:05,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 05:12:05,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:05,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:05,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:05,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:12:05,363 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43331,1689311513888' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-14 05:12:05,363 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@575f0468[Count = 1] remaining members to acquire global barrier 2023-07-14 05:12:05,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:05,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:12:05,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:12:05,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:12:05,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:12:05,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 05:12:05,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:05,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:05,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:05,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:12:05,366 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35487,1689311513755' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-14 05:12:05,366 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@575f0468[Count = 0] remaining members to acquire global barrier 2023-07-14 05:12:05,366 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-14 05:12:05,366 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 05:12:05,370 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 05:12:05,370 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 05:12:05,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 05:12:05,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 05:12:05,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 05:12:05,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 05:12:05,370 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-14 05:12:05,370 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-14 05:12:05,370 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 05:12:05,370 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-14 05:12:05,371 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:05,371 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 05:12:05,371 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 05:12:05,371 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689311523298.08b97c02ecbc544fe8eaaf0b3b4fd37c. 2023-07-14 05:12:05,371 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35535,1689311513825' in zk 2023-07-14 05:12:05,371 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689311523298.08b97c02ecbc544fe8eaaf0b3b4fd37c. started... 2023-07-14 05:12:05,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 05:12:05,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 05:12:05,371 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-14 05:12:05,371 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:05,371 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 05:12:05,371 INFO [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 08b97c02ecbc544fe8eaaf0b3b4fd37c 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-14 05:12:05,372 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 05:12:05,372 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 05:12:05,372 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689311523298.8908752b8022f31f3c456e1893d0818e. 2023-07-14 05:12:05,372 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689311523298.8908752b8022f31f3c456e1893d0818e. started... 2023-07-14 05:12:05,372 INFO [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8908752b8022f31f3c456e1893d0818e 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-14 05:12:05,376 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-14 05:12:05,376 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 05:12:05,376 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-14 05:12:05,481 INFO [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportWithTargetName/8908752b8022f31f3c456e1893d0818e/.tmp/cf/beb1c5f63ed842e88ac2ce66556a96bc 2023-07-14 05:12:05,481 INFO [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportWithTargetName/08b97c02ecbc544fe8eaaf0b3b4fd37c/.tmp/cf/534a5d44d6dc42f1a76408f5b6e65dc1 2023-07-14 05:12:05,535 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportWithTargetName/8908752b8022f31f3c456e1893d0818e/.tmp/cf/beb1c5f63ed842e88ac2ce66556a96bc as hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportWithTargetName/8908752b8022f31f3c456e1893d0818e/cf/beb1c5f63ed842e88ac2ce66556a96bc 2023-07-14 05:12:05,535 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportWithTargetName/08b97c02ecbc544fe8eaaf0b3b4fd37c/.tmp/cf/534a5d44d6dc42f1a76408f5b6e65dc1 as hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportWithTargetName/08b97c02ecbc544fe8eaaf0b3b4fd37c/cf/534a5d44d6dc42f1a76408f5b6e65dc1 2023-07-14 05:12:05,546 INFO [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportWithTargetName/8908752b8022f31f3c456e1893d0818e/cf/beb1c5f63ed842e88ac2ce66556a96bc, entries=3, sequenceid=6, filesize=5.0 K 2023-07-14 05:12:05,552 INFO [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportWithTargetName/08b97c02ecbc544fe8eaaf0b3b4fd37c/cf/534a5d44d6dc42f1a76408f5b6e65dc1, entries=47, sequenceid=6, filesize=8.0 K 2023-07-14 05:12:05,554 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 05:12:05,555 INFO [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 8908752b8022f31f3c456e1893d0818e in 183ms, sequenceid=6, compaction requested=false 2023-07-14 05:12:05,555 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-14 05:12:05,556 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8908752b8022f31f3c456e1893d0818e: 2023-07-14 05:12:05,557 INFO [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 08b97c02ecbc544fe8eaaf0b3b4fd37c in 186ms, sequenceid=6, compaction requested=false 2023-07-14 05:12:05,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 05:12:05,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-14 05:12:05,559 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 08b97c02ecbc544fe8eaaf0b3b4fd37c: 2023-07-14 05:12:05,559 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 05:12:05,559 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689311523298.8908752b8022f31f3c456e1893d0818e.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-14 05:12:05,559 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689311523298.08b97c02ecbc544fe8eaaf0b3b4fd37c.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-14 05:12:05,559 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 05:12:05,559 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 05:12:05,559 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportWithTargetName/08b97c02ecbc544fe8eaaf0b3b4fd37c/cf/534a5d44d6dc42f1a76408f5b6e65dc1] hfiles 2023-07-14 05:12:05,559 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportWithTargetName/8908752b8022f31f3c456e1893d0818e/cf/beb1c5f63ed842e88ac2ce66556a96bc] hfiles 2023-07-14 05:12:05,560 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportWithTargetName/08b97c02ecbc544fe8eaaf0b3b4fd37c/cf/534a5d44d6dc42f1a76408f5b6e65dc1 for snapshot=snaptb0-testExportWithTargetName 2023-07-14 05:12:05,560 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportWithTargetName/8908752b8022f31f3c456e1893d0818e/cf/beb1c5f63ed842e88ac2ce66556a96bc for snapshot=snaptb0-testExportWithTargetName 2023-07-14 05:12:05,584 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689311523298.8908752b8022f31f3c456e1893d0818e. completed. 2023-07-14 05:12:05,584 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689311523298.8908752b8022f31f3c456e1893d0818e. 2023-07-14 05:12:05,584 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 05:12:05,584 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 05:12:05,584 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:05,584 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-14 05:12:05,584 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35487,1689311513755' in zk 2023-07-14 05:12:05,587 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:05,587 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-14 05:12:05,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:05,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:12:05,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:12:05,587 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 05:12:05,587 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689311523298.08b97c02ecbc544fe8eaaf0b3b4fd37c. completed. 2023-07-14 05:12:05,587 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-14 05:12:05,587 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689311523298.08b97c02ecbc544fe8eaaf0b3b4fd37c. 2023-07-14 05:12:05,587 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 05:12:05,587 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 05:12:05,587 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:05,587 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-14 05:12:05,589 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43331,1689311513888' in zk 2023-07-14 05:12:05,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:12:05,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:12:05,591 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-14 05:12:05,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 05:12:05,591 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:05,592 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 05:12:05,592 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-14 05:12:05,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:05,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:05,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:05,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:12:05,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 05:12:05,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:05,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:05,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:05,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,35487,1689311513755': 2023-07-14 05:12:05,596 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35487,1689311513755' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-14 05:12:05,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:05,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:12:05,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:12:05,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:12:05,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:12:05,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 05:12:05,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:05,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:05,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:05,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:12:05,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 05:12:05,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:05,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:05,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:05,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,43331,1689311513888': 2023-07-14 05:12:05,602 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43331,1689311513888' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-14 05:12:05,602 INFO [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-14 05:12:05,602 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 05:12:05,602 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 05:12:05,602 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-14 05:12:05,602 INFO [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 05:12:05,604 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 05:12:05,604 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:12:05,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 05:12:05,604 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 05:12:05,604 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 05:12:05,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 05:12:05,604 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:12:05,604 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:12:05,604 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 05:12:05,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 05:12:05,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 05:12:05,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:12:05,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:12:05,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 05:12:05,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 05:12:05,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 05:12:05,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:12:05,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:12:05,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:12:05,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:12:05,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:12:05,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:12:05,605 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:05,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:12:05,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 05:12:05,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 05:12:05,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 05:12:05,606 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:05,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 05:12:05,607 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:05,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:12:05,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 05:12:05,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:05,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:05,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:05,609 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:05,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:12:05,610 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:05,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 05:12:05,616 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:05,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:05,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:05,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:05,628 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:12:05,628 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:12:05,628 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:12:05,628 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:12:05,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:12:05,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:12:05,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:12:05,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:12:05,629 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:05,629 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 05:12:05,629 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:05,629 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:05,629 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 05:12:05,629 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:12:05,629 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:05,630 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 05:12:05,630 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:05,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:12:05,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:12:05,629 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:12:05,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:12:05,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:12:05,630 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:05,630 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 05:12:05,630 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 05:12:05,630 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-14 05:12:05,630 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 05:12:05,631 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-14 05:12:05,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:12:05,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:12:05,632 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-14 05:12:05,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:12:05,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:12:05,679 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-14 05:12:05,859 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 05:12:05,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 05:12:05,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-14 05:12:05,861 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-14 05:12:06,175 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-14 05:12:06,175 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-14 05:12:06,175 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-14 05:12:06,176 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689311525246Consolidate snapshot: snaptb0-testExportWithTargetName at 1689311525631 (+385 ms)Loading Region manifests for snaptb0-testExportWithTargetName at 1689311525631Writing data manifest for snaptb0-testExportWithTargetName at 1689311525639 (+8 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689311525668 (+29 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689311526175 (+507 ms) 2023-07-14 05:12:06,179 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-14 05:12:06,183 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 932 msec 2023-07-14 05:12:06,362 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 05:12:06,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 05:12:06,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 05:12:06,366 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/export-test/export-1689311526365 2023-07-14 05:12:06,366 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36535, tgtDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/export-test/export-1689311526365, rawTgtDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/export-test/export-1689311526365, srcFsUri=hdfs://localhost:36535, srcDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48 2023-07-14 05:12:06,418 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36535, inputRoot=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48 2023-07-14 05:12:06,418 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_829443971_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/export-test/export-1689311526365, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/export-test/export-1689311526365/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-14 05:12:06,418 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36535, inputRoot=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48, snapshotDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-14 05:12:06,453 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/export-test/export-1689311526365/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-14 05:12:06,567 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 05:12:06,568 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 05:12:06,569 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 05:12:06,569 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 05:12:06,570 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-14 05:12:06,570 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 05:12:06,570 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 05:12:06,661 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/hadoop-8067321627371647624.jar 2023-07-14 05:12:06,661 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 05:12:06,662 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 05:12:06,662 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 05:12:06,663 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 05:12:06,663 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 05:12:06,664 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 05:12:06,664 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 05:12:06,664 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 05:12:06,665 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 05:12:06,665 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 05:12:06,666 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 05:12:06,666 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 05:12:06,667 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 05:12:06,667 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 05:12:06,667 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 05:12:06,668 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 05:12:06,671 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 05:12:06,672 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 05:12:06,672 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 05:12:06,672 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 05:12:06,673 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 05:12:06,673 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 05:12:06,673 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 05:12:07,762 WARN [Listener at jenkins-hbase4.apache.org/38651] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 05:12:07,769 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-14 05:12:07,786 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-14 05:12:08,310 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 05:12:08,312 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 05:12:08,941 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689311521774_0001_000001 (auth:SIMPLE) 2023-07-14 05:12:09,314 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 05:12:14,198 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689311521774_0001_000001 (auth:SIMPLE) 2023-07-14 05:12:16,477 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689311521774_0001_000001 (auth:SIMPLE) 2023-07-14 05:12:19,587 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689311521774_0001_000001 (auth:SIMPLE) 2023-07-14 05:12:21,693 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 05:12:21,696 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 05:12:21,704 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-14 05:12:21,705 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 05:12:21,705 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 05:12:21,706 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-839015254_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-14 05:12:21,706 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(367): hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-14 05:12:21,706 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(367): hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-14 05:12:21,706 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-839015254_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/export-test/export-1689311526365/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/export-test/export-1689311526365/.hbase-snapshot/testExportWithTargetName 2023-07-14 05:12:21,707 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(367): hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/export-test/export-1689311526365/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-14 05:12:21,707 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(367): hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/export-test/export-1689311526365/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-14 05:12:21,717 INFO [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-14 05:12:21,722 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-14 05:12:21,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-14 05:12:21,735 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689311541734"}]},"ts":"1689311541734"} 2023-07-14 05:12:21,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-14 05:12:21,736 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-14 05:12:21,738 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-14 05:12:21,740 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8908752b8022f31f3c456e1893d0818e, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=08b97c02ecbc544fe8eaaf0b3b4fd37c, UNASSIGN}] 2023-07-14 05:12:21,742 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8908752b8022f31f3c456e1893d0818e, UNASSIGN 2023-07-14 05:12:21,742 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=08b97c02ecbc544fe8eaaf0b3b4fd37c, UNASSIGN 2023-07-14 05:12:21,743 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=8908752b8022f31f3c456e1893d0818e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:21,744 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=08b97c02ecbc544fe8eaaf0b3b4fd37c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:21,744 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689311523298.8908752b8022f31f3c456e1893d0818e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689311541743"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689311541743"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689311541743"}]},"ts":"1689311541743"} 2023-07-14 05:12:21,744 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689311523298.08b97c02ecbc544fe8eaaf0b3b4fd37c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689311541743"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689311541743"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689311541743"}]},"ts":"1689311541743"} 2023-07-14 05:12:21,746 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 8908752b8022f31f3c456e1893d0818e, server=jenkins-hbase4.apache.org,35487,1689311513755}] 2023-07-14 05:12:21,749 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 08b97c02ecbc544fe8eaaf0b3b4fd37c, server=jenkins-hbase4.apache.org,43331,1689311513888}] 2023-07-14 05:12:21,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-14 05:12:21,909 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 08b97c02ecbc544fe8eaaf0b3b4fd37c 2023-07-14 05:12:21,909 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8908752b8022f31f3c456e1893d0818e 2023-07-14 05:12:21,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 08b97c02ecbc544fe8eaaf0b3b4fd37c, disabling compactions & flushes 2023-07-14 05:12:21,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8908752b8022f31f3c456e1893d0818e, disabling compactions & flushes 2023-07-14 05:12:21,909 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689311523298.08b97c02ecbc544fe8eaaf0b3b4fd37c. 2023-07-14 05:12:21,909 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689311523298.8908752b8022f31f3c456e1893d0818e. 2023-07-14 05:12:21,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689311523298.08b97c02ecbc544fe8eaaf0b3b4fd37c. 2023-07-14 05:12:21,910 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689311523298.8908752b8022f31f3c456e1893d0818e. 2023-07-14 05:12:21,910 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689311523298.08b97c02ecbc544fe8eaaf0b3b4fd37c. after waiting 0 ms 2023-07-14 05:12:21,910 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689311523298.8908752b8022f31f3c456e1893d0818e. after waiting 0 ms 2023-07-14 05:12:21,910 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689311523298.08b97c02ecbc544fe8eaaf0b3b4fd37c. 2023-07-14 05:12:21,910 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689311523298.8908752b8022f31f3c456e1893d0818e. 2023-07-14 05:12:21,928 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportWithTargetName/8908752b8022f31f3c456e1893d0818e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 05:12:21,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportWithTargetName/08b97c02ecbc544fe8eaaf0b3b4fd37c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 05:12:21,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 05:12:21,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 05:12:21,930 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689311523298.8908752b8022f31f3c456e1893d0818e. 2023-07-14 05:12:21,931 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689311523298.08b97c02ecbc544fe8eaaf0b3b4fd37c. 2023-07-14 05:12:21,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8908752b8022f31f3c456e1893d0818e: 2023-07-14 05:12:21,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 08b97c02ecbc544fe8eaaf0b3b4fd37c: 2023-07-14 05:12:21,934 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8908752b8022f31f3c456e1893d0818e 2023-07-14 05:12:21,935 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=8908752b8022f31f3c456e1893d0818e, regionState=CLOSED 2023-07-14 05:12:21,935 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689311523298.8908752b8022f31f3c456e1893d0818e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689311541935"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689311541935"}]},"ts":"1689311541935"} 2023-07-14 05:12:21,936 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=08b97c02ecbc544fe8eaaf0b3b4fd37c, regionState=CLOSED 2023-07-14 05:12:21,936 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689311523298.08b97c02ecbc544fe8eaaf0b3b4fd37c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689311541936"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689311541936"}]},"ts":"1689311541936"} 2023-07-14 05:12:21,937 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 08b97c02ecbc544fe8eaaf0b3b4fd37c 2023-07-14 05:12:21,941 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-14 05:12:21,941 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 8908752b8022f31f3c456e1893d0818e, server=jenkins-hbase4.apache.org,35487,1689311513755 in 191 msec 2023-07-14 05:12:21,942 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-14 05:12:21,943 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 08b97c02ecbc544fe8eaaf0b3b4fd37c, server=jenkins-hbase4.apache.org,43331,1689311513888 in 189 msec 2023-07-14 05:12:21,944 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8908752b8022f31f3c456e1893d0818e, UNASSIGN in 201 msec 2023-07-14 05:12:21,945 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=21 2023-07-14 05:12:21,945 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=08b97c02ecbc544fe8eaaf0b3b4fd37c, UNASSIGN in 203 msec 2023-07-14 05:12:21,947 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689311541946"}]},"ts":"1689311541946"} 2023-07-14 05:12:21,952 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-14 05:12:21,954 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-14 05:12:21,957 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 230 msec 2023-07-14 05:12:22,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-14 05:12:22,038 INFO [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-14 05:12:22,043 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-14 05:12:22,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-14 05:12:22,053 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-14 05:12:22,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-14 05:12:22,056 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-14 05:12:22,059 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35487] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-14 05:12:22,061 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-14 05:12:22,061 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-14 05:12:22,061 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-14 05:12:22,061 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-14 05:12:22,062 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportWithTargetName/8908752b8022f31f3c456e1893d0818e 2023-07-14 05:12:22,062 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportWithTargetName/08b97c02ecbc544fe8eaaf0b3b4fd37c 2023-07-14 05:12:22,062 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-14 05:12:22,062 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-14 05:12:22,063 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-14 05:12:22,063 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-14 05:12:22,063 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-14 05:12:22,063 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-14 05:12:22,063 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 05:12:22,064 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-14 05:12:22,064 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 05:12:22,064 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-14 05:12:22,064 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 05:12:22,064 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 05:12:22,066 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportWithTargetName/08b97c02ecbc544fe8eaaf0b3b4fd37c/cf, FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportWithTargetName/08b97c02ecbc544fe8eaaf0b3b4fd37c/recovered.edits] 2023-07-14 05:12:22,066 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportWithTargetName/8908752b8022f31f3c456e1893d0818e/cf, FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportWithTargetName/8908752b8022f31f3c456e1893d0818e/recovered.edits] 2023-07-14 05:12:22,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-14 05:12:22,075 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportWithTargetName/08b97c02ecbc544fe8eaaf0b3b4fd37c/cf/534a5d44d6dc42f1a76408f5b6e65dc1 to hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/archive/data/default/testtb-testExportWithTargetName/08b97c02ecbc544fe8eaaf0b3b4fd37c/cf/534a5d44d6dc42f1a76408f5b6e65dc1 2023-07-14 05:12:22,075 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportWithTargetName/8908752b8022f31f3c456e1893d0818e/cf/beb1c5f63ed842e88ac2ce66556a96bc to hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/archive/data/default/testtb-testExportWithTargetName/8908752b8022f31f3c456e1893d0818e/cf/beb1c5f63ed842e88ac2ce66556a96bc 2023-07-14 05:12:22,079 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportWithTargetName/08b97c02ecbc544fe8eaaf0b3b4fd37c/recovered.edits/9.seqid to hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/archive/data/default/testtb-testExportWithTargetName/08b97c02ecbc544fe8eaaf0b3b4fd37c/recovered.edits/9.seqid 2023-07-14 05:12:22,080 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportWithTargetName/8908752b8022f31f3c456e1893d0818e/recovered.edits/9.seqid to hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/archive/data/default/testtb-testExportWithTargetName/8908752b8022f31f3c456e1893d0818e/recovered.edits/9.seqid 2023-07-14 05:12:22,080 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportWithTargetName/08b97c02ecbc544fe8eaaf0b3b4fd37c 2023-07-14 05:12:22,081 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportWithTargetName/8908752b8022f31f3c456e1893d0818e 2023-07-14 05:12:22,081 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-14 05:12:22,084 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-14 05:12:22,106 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-14 05:12:22,110 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-14 05:12:22,112 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-14 05:12:22,113 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-14 05:12:22,113 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689311523298.8908752b8022f31f3c456e1893d0818e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689311542113"}]},"ts":"9223372036854775807"} 2023-07-14 05:12:22,113 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689311523298.08b97c02ecbc544fe8eaaf0b3b4fd37c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689311542113"}]},"ts":"9223372036854775807"} 2023-07-14 05:12:22,116 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-14 05:12:22,116 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 8908752b8022f31f3c456e1893d0818e, NAME => 'testtb-testExportWithTargetName,,1689311523298.8908752b8022f31f3c456e1893d0818e.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 08b97c02ecbc544fe8eaaf0b3b4fd37c, NAME => 'testtb-testExportWithTargetName,1,1689311523298.08b97c02ecbc544fe8eaaf0b3b4fd37c.', STARTKEY => '1', ENDKEY => ''}] 2023-07-14 05:12:22,116 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-14 05:12:22,117 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689311542116"}]},"ts":"9223372036854775807"} 2023-07-14 05:12:22,123 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-14 05:12:22,127 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-14 05:12:22,135 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 83 msec 2023-07-14 05:12:22,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-14 05:12:22,170 INFO [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-14 05:12:22,192 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-14 05:12:22,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-14 05:12:22,198 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-14 05:12:22,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-14 05:12:22,228 INFO [Listener at jenkins-hbase4.apache.org/38651] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=752 (was 708) Potentially hanging thread: (jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/cluster_0a5de1ae-f170-3a29-48d6-c867fdd6855b/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-839015254_17 at /127.0.0.1:38190 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x11720e3f-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x11720e3f-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-839015254_17 at /127.0.0.1:51270 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1282 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x11720e3f-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/cluster_0a5de1ae-f170-3a29-48d6-c867fdd6855b/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/cluster_0a5de1ae-f170-3a29-48d6-c867fdd6855b/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x11720e3f-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (145847449) connection to jenkins-hbase4.apache.org/172.31.14.131:40703 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/cluster_0a5de1ae-f170-3a29-48d6-c867fdd6855b/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-839015254_17 at /127.0.0.1:59126 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (145847449) connection to jenkins-hbase4.apache.org/172.31.14.131:41835 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/cluster_0a5de1ae-f170-3a29-48d6-c867fdd6855b/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/cluster_0a5de1ae-f170-3a29-48d6-c867fdd6855b/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1342861041_1 at /127.0.0.1:37066 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=916 (was 898) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=252 (was 306), ProcessCount=181 (was 175) - ProcessCount LEAK? -, AvailableMemoryMB=3904 (was 5753) 2023-07-14 05:12:22,228 WARN [Listener at jenkins-hbase4.apache.org/38651] hbase.ResourceChecker(130): Thread=752 is superior to 500 2023-07-14 05:12:22,248 INFO [Listener at jenkins-hbase4.apache.org/38651] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=752, OpenFileDescriptor=916, MaxFileDescriptor=60000, SystemLoadAverage=252, ProcessCount=181, AvailableMemoryMB=3903 2023-07-14 05:12:22,249 WARN [Listener at jenkins-hbase4.apache.org/38651] hbase.ResourceChecker(130): Thread=752 is superior to 500 2023-07-14 05:12:22,251 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-14 05:12:22,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-14 05:12:22,255 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 05:12:22,255 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-14 05:12:22,256 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 05:12:22,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-14 05:12:22,259 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemState/70e6e658c3a637e4f0137743b54eab1a 2023-07-14 05:12:22,259 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemState/97cf7159f42a606df117d892436af894 2023-07-14 05:12:22,260 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemState/70e6e658c3a637e4f0137743b54eab1a empty. 2023-07-14 05:12:22,260 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemState/97cf7159f42a606df117d892436af894 empty. 2023-07-14 05:12:22,260 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemState/70e6e658c3a637e4f0137743b54eab1a 2023-07-14 05:12:22,260 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemState/97cf7159f42a606df117d892436af894 2023-07-14 05:12:22,260 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-14 05:12:22,277 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-14 05:12:22,278 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 70e6e658c3a637e4f0137743b54eab1a, NAME => 'testtb-testExportFileSystemState,,1689311542250.70e6e658c3a637e4f0137743b54eab1a.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp 2023-07-14 05:12:22,279 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 97cf7159f42a606df117d892436af894, NAME => 'testtb-testExportFileSystemState,1,1689311542250.97cf7159f42a606df117d892436af894.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp 2023-07-14 05:12:22,296 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689311542250.97cf7159f42a606df117d892436af894.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 05:12:22,296 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689311542250.70e6e658c3a637e4f0137743b54eab1a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 05:12:22,298 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 97cf7159f42a606df117d892436af894, disabling compactions & flushes 2023-07-14 05:12:22,298 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 70e6e658c3a637e4f0137743b54eab1a, disabling compactions & flushes 2023-07-14 05:12:22,298 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689311542250.97cf7159f42a606df117d892436af894. 2023-07-14 05:12:22,298 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689311542250.70e6e658c3a637e4f0137743b54eab1a. 2023-07-14 05:12:22,298 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689311542250.97cf7159f42a606df117d892436af894. 2023-07-14 05:12:22,298 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689311542250.70e6e658c3a637e4f0137743b54eab1a. 2023-07-14 05:12:22,298 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689311542250.97cf7159f42a606df117d892436af894. after waiting 0 ms 2023-07-14 05:12:22,298 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689311542250.70e6e658c3a637e4f0137743b54eab1a. after waiting 0 ms 2023-07-14 05:12:22,298 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689311542250.97cf7159f42a606df117d892436af894. 2023-07-14 05:12:22,299 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689311542250.70e6e658c3a637e4f0137743b54eab1a. 2023-07-14 05:12:22,299 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689311542250.97cf7159f42a606df117d892436af894. 2023-07-14 05:12:22,299 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689311542250.70e6e658c3a637e4f0137743b54eab1a. 2023-07-14 05:12:22,299 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 70e6e658c3a637e4f0137743b54eab1a: 2023-07-14 05:12:22,299 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 97cf7159f42a606df117d892436af894: 2023-07-14 05:12:22,302 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 05:12:22,304 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689311542250.70e6e658c3a637e4f0137743b54eab1a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689311542303"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689311542303"}]},"ts":"1689311542303"} 2023-07-14 05:12:22,304 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689311542250.97cf7159f42a606df117d892436af894.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689311542303"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689311542303"}]},"ts":"1689311542303"} 2023-07-14 05:12:22,307 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 05:12:22,308 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 05:12:22,308 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689311542308"}]},"ts":"1689311542308"} 2023-07-14 05:12:22,310 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-14 05:12:22,314 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-14 05:12:22,316 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 05:12:22,316 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 05:12:22,316 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 05:12:22,316 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 05:12:22,316 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=70e6e658c3a637e4f0137743b54eab1a, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=97cf7159f42a606df117d892436af894, ASSIGN}] 2023-07-14 05:12:22,319 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=70e6e658c3a637e4f0137743b54eab1a, ASSIGN 2023-07-14 05:12:22,319 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=97cf7159f42a606df117d892436af894, ASSIGN 2023-07-14 05:12:22,320 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=70e6e658c3a637e4f0137743b54eab1a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35487,1689311513755; forceNewPlan=false, retain=false 2023-07-14 05:12:22,320 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=97cf7159f42a606df117d892436af894, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35535,1689311513825; forceNewPlan=false, retain=false 2023-07-14 05:12:22,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-14 05:12:22,471 INFO [jenkins-hbase4:35845] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 05:12:22,474 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=97cf7159f42a606df117d892436af894, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:22,474 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=70e6e658c3a637e4f0137743b54eab1a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:22,474 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689311542250.97cf7159f42a606df117d892436af894.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689311542474"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689311542474"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689311542474"}]},"ts":"1689311542474"} 2023-07-14 05:12:22,474 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689311542250.70e6e658c3a637e4f0137743b54eab1a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689311542474"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689311542474"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689311542474"}]},"ts":"1689311542474"} 2023-07-14 05:12:22,476 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 97cf7159f42a606df117d892436af894, server=jenkins-hbase4.apache.org,35535,1689311513825}] 2023-07-14 05:12:22,477 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 70e6e658c3a637e4f0137743b54eab1a, server=jenkins-hbase4.apache.org,35487,1689311513755}] 2023-07-14 05:12:22,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-14 05:12:22,630 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:22,630 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-14 05:12:22,635 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45578, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-14 05:12:22,641 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689311542250.70e6e658c3a637e4f0137743b54eab1a. 2023-07-14 05:12:22,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 70e6e658c3a637e4f0137743b54eab1a, NAME => 'testtb-testExportFileSystemState,,1689311542250.70e6e658c3a637e4f0137743b54eab1a.', STARTKEY => '', ENDKEY => '1'} 2023-07-14 05:12:22,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689311542250.70e6e658c3a637e4f0137743b54eab1a. service=AccessControlService 2023-07-14 05:12:22,641 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 05:12:22,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 70e6e658c3a637e4f0137743b54eab1a 2023-07-14 05:12:22,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689311542250.70e6e658c3a637e4f0137743b54eab1a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 05:12:22,642 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689311542250.97cf7159f42a606df117d892436af894. 2023-07-14 05:12:22,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 70e6e658c3a637e4f0137743b54eab1a 2023-07-14 05:12:22,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 70e6e658c3a637e4f0137743b54eab1a 2023-07-14 05:12:22,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 97cf7159f42a606df117d892436af894, NAME => 'testtb-testExportFileSystemState,1,1689311542250.97cf7159f42a606df117d892436af894.', STARTKEY => '1', ENDKEY => ''} 2023-07-14 05:12:22,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689311542250.97cf7159f42a606df117d892436af894. service=AccessControlService 2023-07-14 05:12:22,643 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 05:12:22,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 97cf7159f42a606df117d892436af894 2023-07-14 05:12:22,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689311542250.97cf7159f42a606df117d892436af894.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 05:12:22,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 97cf7159f42a606df117d892436af894 2023-07-14 05:12:22,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 97cf7159f42a606df117d892436af894 2023-07-14 05:12:22,643 INFO [StoreOpener-70e6e658c3a637e4f0137743b54eab1a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 70e6e658c3a637e4f0137743b54eab1a 2023-07-14 05:12:22,644 INFO [StoreOpener-97cf7159f42a606df117d892436af894-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 97cf7159f42a606df117d892436af894 2023-07-14 05:12:22,645 DEBUG [StoreOpener-70e6e658c3a637e4f0137743b54eab1a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemState/70e6e658c3a637e4f0137743b54eab1a/cf 2023-07-14 05:12:22,645 DEBUG [StoreOpener-70e6e658c3a637e4f0137743b54eab1a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemState/70e6e658c3a637e4f0137743b54eab1a/cf 2023-07-14 05:12:22,646 INFO [StoreOpener-70e6e658c3a637e4f0137743b54eab1a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 70e6e658c3a637e4f0137743b54eab1a columnFamilyName cf 2023-07-14 05:12:22,646 DEBUG [StoreOpener-97cf7159f42a606df117d892436af894-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemState/97cf7159f42a606df117d892436af894/cf 2023-07-14 05:12:22,646 DEBUG [StoreOpener-97cf7159f42a606df117d892436af894-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemState/97cf7159f42a606df117d892436af894/cf 2023-07-14 05:12:22,646 INFO [StoreOpener-70e6e658c3a637e4f0137743b54eab1a-1] regionserver.HStore(310): Store=70e6e658c3a637e4f0137743b54eab1a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 05:12:22,647 INFO [StoreOpener-97cf7159f42a606df117d892436af894-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 97cf7159f42a606df117d892436af894 columnFamilyName cf 2023-07-14 05:12:22,648 INFO [StoreOpener-97cf7159f42a606df117d892436af894-1] regionserver.HStore(310): Store=97cf7159f42a606df117d892436af894/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 05:12:22,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemState/70e6e658c3a637e4f0137743b54eab1a 2023-07-14 05:12:22,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemState/70e6e658c3a637e4f0137743b54eab1a 2023-07-14 05:12:22,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemState/97cf7159f42a606df117d892436af894 2023-07-14 05:12:22,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemState/97cf7159f42a606df117d892436af894 2023-07-14 05:12:22,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 70e6e658c3a637e4f0137743b54eab1a 2023-07-14 05:12:22,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 97cf7159f42a606df117d892436af894 2023-07-14 05:12:22,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemState/70e6e658c3a637e4f0137743b54eab1a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 05:12:22,658 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 70e6e658c3a637e4f0137743b54eab1a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72665213, jitterRate=0.08279605209827423}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 05:12:22,658 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 70e6e658c3a637e4f0137743b54eab1a: 2023-07-14 05:12:22,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemState/97cf7159f42a606df117d892436af894/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 05:12:22,659 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689311542250.70e6e658c3a637e4f0137743b54eab1a., pid=31, masterSystemTime=1689311542631 2023-07-14 05:12:22,659 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 97cf7159f42a606df117d892436af894; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64868907, jitterRate=-0.033377960324287415}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 05:12:22,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 97cf7159f42a606df117d892436af894: 2023-07-14 05:12:22,660 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689311542250.97cf7159f42a606df117d892436af894., pid=30, masterSystemTime=1689311542630 2023-07-14 05:12:22,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689311542250.70e6e658c3a637e4f0137743b54eab1a. 2023-07-14 05:12:22,664 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689311542250.70e6e658c3a637e4f0137743b54eab1a. 2023-07-14 05:12:22,664 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=70e6e658c3a637e4f0137743b54eab1a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:22,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689311542250.97cf7159f42a606df117d892436af894. 2023-07-14 05:12:22,665 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689311542250.97cf7159f42a606df117d892436af894. 2023-07-14 05:12:22,665 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689311542250.70e6e658c3a637e4f0137743b54eab1a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689311542664"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689311542664"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689311542664"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689311542664"}]},"ts":"1689311542664"} 2023-07-14 05:12:22,666 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=97cf7159f42a606df117d892436af894, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:22,666 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689311542250.97cf7159f42a606df117d892436af894.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689311542666"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689311542666"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689311542666"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689311542666"}]},"ts":"1689311542666"} 2023-07-14 05:12:22,670 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-14 05:12:22,671 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 70e6e658c3a637e4f0137743b54eab1a, server=jenkins-hbase4.apache.org,35487,1689311513755 in 190 msec 2023-07-14 05:12:22,676 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-14 05:12:22,677 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 97cf7159f42a606df117d892436af894, server=jenkins-hbase4.apache.org,35535,1689311513825 in 193 msec 2023-07-14 05:12:22,677 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=70e6e658c3a637e4f0137743b54eab1a, ASSIGN in 354 msec 2023-07-14 05:12:22,682 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-07-14 05:12:22,682 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=97cf7159f42a606df117d892436af894, ASSIGN in 361 msec 2023-07-14 05:12:22,683 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 05:12:22,683 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689311542683"}]},"ts":"1689311542683"} 2023-07-14 05:12:22,685 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-14 05:12:22,689 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 05:12:22,689 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-14 05:12:22,691 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35487] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-14 05:12:22,693 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 05:12:22,693 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 05:12:22,693 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 05:12:22,693 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 05:12:22,694 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 05:12:22,695 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 05:12:22,695 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 05:12:22,696 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 05:12:22,698 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 443 msec 2023-07-14 05:12:22,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-14 05:12:22,861 INFO [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-14 05:12:22,861 DEBUG [Listener at jenkins-hbase4.apache.org/38651] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemState get assigned. Timeout = 60000ms 2023-07-14 05:12:22,861 INFO [Listener at jenkins-hbase4.apache.org/38651] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 05:12:22,864 INFO [Listener at jenkins-hbase4.apache.org/38651] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemState assigned to meta. Checking AM states. 2023-07-14 05:12:22,865 INFO [Listener at jenkins-hbase4.apache.org/38651] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 05:12:22,865 INFO [Listener at jenkins-hbase4.apache.org/38651] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemState assigned. 2023-07-14 05:12:22,868 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 05:12:22,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689311542868 (current time:1689311542868). 2023-07-14 05:12:22,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 05:12:22,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] zookeeper.ReadOnlyZKClient(139): Connect 0x34b38682 to 127.0.0.1:55310 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 05:12:22,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@47ef042e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 05:12:22,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 05:12:22,879 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44432, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 05:12:22,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x34b38682 to 127.0.0.1:55310 2023-07-14 05:12:22,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 05:12:22,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] zookeeper.ReadOnlyZKClient(139): Connect 0x1c8d9b00 to 127.0.0.1:55310 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 05:12:22,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@34a28985, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 05:12:22,887 DEBUG [hconnection-0xbd3254b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 05:12:22,888 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44440, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 05:12:22,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 05:12:22,893 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54892, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 05:12:22,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1c8d9b00 to 127.0.0.1:55310 2023-07-14 05:12:22,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 05:12:22,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-14 05:12:22,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 05:12:22,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 05:12:22,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-14 05:12:22,902 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-14 05:12:22,903 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689312142903 2023-07-14 05:12:22,903 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-14 05:12:22,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 05:12:22,904 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 05:12:22,904 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 05:12:22,906 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-14 05:12:22,906 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-14 05:12:22,916 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-07-14 05:12:22,918 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-14 05:12:22,920 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689312142920 2023-07-14 05:12:22,965 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:22,965 INFO [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-14 05:12:22,966 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 05:12:22,967 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-14 05:12:22,968 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-14 05:12:22,969 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:22,969 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:22,974 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:12:22,974 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:12:22,974 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:22,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:12:22,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:12:22,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:12:22,974 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:12:22,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:12:22,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:12:22,975 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:22,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:12:22,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:22,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:22,975 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:22,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:22,976 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:22,976 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:22,976 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:22,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-14 05:12:22,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:22,977 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-14 05:12:22,976 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:22,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-14 05:12:22,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:22,978 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-14 05:12:22,976 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 05:12:22,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-14 05:12:22,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:22,978 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-14 05:12:22,982 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:22,983 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-14 05:12:22,983 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 05:12:22,986 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:22,987 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-14 05:12:22,987 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 05:12:22,989 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:22,989 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-14 05:12:22,991 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-14 05:12:22,992 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-14 05:12:22,992 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35487,1689311513755' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-14 05:12:22,991 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-14 05:12:22,992 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-14 05:12:22,993 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43331,1689311513888' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-14 05:12:22,992 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 05:12:22,994 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-14 05:12:22,994 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-14 05:12:22,994 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35535,1689311513825' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-14 05:12:22,996 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:22,996 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:22,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:22,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:12:22,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:12:23,003 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:23,003 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:23,003 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 05:12:23,003 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:23,003 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:23,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:12:23,004 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:23,004 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 05:12:23,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:12:23,004 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:23,004 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 05:12:23,005 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 05:12:23,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:23,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:23,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 05:12:23,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 05:12:23,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:23,007 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 05:12:23,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:23,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:12:23,008 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35487,1689311513755' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-14 05:12:23,008 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@49d0ef4d[Count = 1] remaining members to acquire global barrier 2023-07-14 05:12:23,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:23,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:12:23,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:12:23,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:12:23,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:12:23,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:23,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:23,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:23,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:23,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:12:23,011 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35535,1689311513825' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-14 05:12:23,011 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@49d0ef4d[Count = 0] remaining members to acquire global barrier 2023-07-14 05:12:23,011 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-14 05:12:23,011 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:23,012 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:23,012 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:23,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:23,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:23,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:23,012 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:23,013 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-14 05:12:23,013 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-14 05:12:23,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:23,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:23,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:23,013 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-14 05:12:23,013 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43331,1689311513888' in zk 2023-07-14 05:12:23,013 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:23,013 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-14 05:12:23,014 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:23,014 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 05:12:23,016 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-14 05:12:23,017 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 05:12:23,017 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-14 05:12:23,018 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 05:12:23,027 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689311542250.97cf7159f42a606df117d892436af894. 2023-07-14 05:12:23,027 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 05:12:23,026 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 05:12:23,027 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 05:12:23,024 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689311542250.70e6e658c3a637e4f0137743b54eab1a. 2023-07-14 05:12:23,027 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689311542250.97cf7159f42a606df117d892436af894. started... 2023-07-14 05:12:23,027 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689311542250.70e6e658c3a637e4f0137743b54eab1a. started... 2023-07-14 05:12:23,029 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 70e6e658c3a637e4f0137743b54eab1a: 2023-07-14 05:12:23,029 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 97cf7159f42a606df117d892436af894: 2023-07-14 05:12:23,029 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689311542250.70e6e658c3a637e4f0137743b54eab1a.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:23,029 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689311542250.97cf7159f42a606df117d892436af894.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:23,029 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 05:12:23,029 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 05:12:23,029 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 05:12:23,029 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 05:12:23,064 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689311542250.70e6e658c3a637e4f0137743b54eab1a. completed. 2023-07-14 05:12:23,064 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689311542250.70e6e658c3a637e4f0137743b54eab1a. 2023-07-14 05:12:23,064 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689311542250.97cf7159f42a606df117d892436af894. completed. 2023-07-14 05:12:23,064 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 05:12:23,064 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 05:12:23,064 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689311542250.97cf7159f42a606df117d892436af894. 2023-07-14 05:12:23,064 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:23,065 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-14 05:12:23,065 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35487,1689311513755' in zk 2023-07-14 05:12:23,065 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 05:12:23,065 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 05:12:23,065 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:23,065 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-14 05:12:23,065 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35535,1689311513825' in zk 2023-07-14 05:12:23,066 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:23,066 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-14 05:12:23,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:23,067 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 05:12:23,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:12:23,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:12:23,067 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-14 05:12:23,068 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-14 05:12:23,068 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:23,068 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 05:12:23,068 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-14 05:12:23,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:12:23,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:12:23,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:23,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:23,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:23,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:23,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:12:23,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:23,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:23,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:23,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:23,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,35487,1689311513755': 2023-07-14 05:12:23,073 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35487,1689311513755' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-14 05:12:23,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:23,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:12:23,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:12:23,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:12:23,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:12:23,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:23,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:23,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:23,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:23,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:12:23,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:23,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:23,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:23,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:23,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,35535,1689311513825': 2023-07-14 05:12:23,077 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35535,1689311513825' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-14 05:12:23,077 INFO [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-14 05:12:23,077 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 05:12:23,077 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 05:12:23,077 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:23,077 INFO [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 05:12:23,079 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:23,079 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:23,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:23,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:23,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:23,080 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:23,080 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:12:23,080 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:12:23,079 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:23,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:23,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:12:23,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:12:23,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:23,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:23,080 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:12:23,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:23,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:12:23,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:12:23,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:12:23,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:12:23,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:12:23,081 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:23,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:12:23,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:12:23,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:23,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:23,081 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:23,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:23,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:23,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:12:23,082 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:23,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:23,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:23,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:23,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:23,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:12:23,086 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:23,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:23,086 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:23,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:23,087 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:23,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:23,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:23,091 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:12:23,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:12:23,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:12:23,091 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:23,091 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:12:23,091 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:12:23,091 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:12:23,091 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:23,091 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:12:23,091 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:12:23,091 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:23,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:12:23,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:12:23,091 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:23,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:12:23,092 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:23,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:12:23,091 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 05:12:23,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:12:23,091 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:23,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:12:23,095 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:23,095 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:23,095 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:23,095 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:23,095 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:23,095 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:23,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:12:23,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:12:23,095 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:23,095 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:23,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:12:23,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:12:23,127 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:23,153 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-14 05:12:23,153 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:23,154 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:23,154 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689311542903Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689311543092 (+189 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689311543092Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689311543099 (+7 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689311543119 (+20 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689311543153 (+34 ms) 2023-07-14 05:12:23,156 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-14 05:12:23,158 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 252 msec 2023-07-14 05:12:23,207 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 05:12:23,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 05:12:23,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 05:12:23,220 DEBUG [htable-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 05:12:23,221 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35487] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689311542250.70e6e658c3a637e4f0137743b54eab1a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 05:12:23,229 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45580, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 05:12:23,232 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35535] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689311542250.97cf7159f42a606df117d892436af894. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 05:12:23,239 DEBUG [Listener at jenkins-hbase4.apache.org/38651] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-14 05:12:23,239 DEBUG [Listener at jenkins-hbase4.apache.org/38651] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689311542250.70e6e658c3a637e4f0137743b54eab1a. 2023-07-14 05:12:23,239 INFO [Listener at jenkins-hbase4.apache.org/38651] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 05:12:23,267 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 05:12:23,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689311543268 (current time:1689311543268). 2023-07-14 05:12:23,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 05:12:23,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] zookeeper.ReadOnlyZKClient(139): Connect 0x1f957a0a to 127.0.0.1:55310 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 05:12:23,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@69f7cd70, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 05:12:23,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 05:12:23,279 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44444, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 05:12:23,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1f957a0a to 127.0.0.1:55310 2023-07-14 05:12:23,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 05:12:23,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] zookeeper.ReadOnlyZKClient(139): Connect 0x3bbf983e to 127.0.0.1:55310 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 05:12:23,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@fcef069, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 05:12:23,293 DEBUG [hconnection-0x580520ad-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 05:12:23,296 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44450, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 05:12:23,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 05:12:23,304 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54894, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 05:12:23,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3bbf983e to 127.0.0.1:55310 2023-07-14 05:12:23,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 05:12:23,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-14 05:12:23,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 05:12:23,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 05:12:23,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-14 05:12:23,311 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-14 05:12:23,312 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689312143312 2023-07-14 05:12:23,312 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-14 05:12:23,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 05:12:23,313 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 05:12:23,314 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 05:12:23,315 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-14 05:12:23,316 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-14 05:12:23,318 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-07-14 05:12:23,320 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-14 05:12:23,321 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689312143321 2023-07-14 05:12:23,342 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-14 05:12:23,343 INFO [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-14 05:12:23,343 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 05:12:23,345 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-14 05:12:23,345 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-14 05:12:23,345 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 05:12:23,345 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 05:12:23,347 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:23,347 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:12:23,347 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:12:23,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:12:23,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:12:23,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:12:23,347 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:12:23,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:12:23,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:12:23,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:12:23,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 05:12:23,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 05:12:23,348 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 05:12:23,348 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 05:12:23,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-14 05:12:23,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 05:12:23,348 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:23,349 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:23,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 05:12:23,349 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-14 05:12:23,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-14 05:12:23,349 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 05:12:23,349 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:23,349 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 05:12:23,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 05:12:23,349 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-14 05:12:23,350 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-14 05:12:23,350 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-14 05:12:23,350 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 05:12:23,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-14 05:12:23,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 05:12:23,351 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-14 05:12:23,351 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-14 05:12:23,352 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-14 05:12:23,352 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-14 05:12:23,352 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-14 05:12:23,352 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 05:12:23,352 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35535,1689311513825' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-14 05:12:23,353 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-14 05:12:23,354 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-14 05:12:23,354 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-14 05:12:23,354 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 05:12:23,354 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-14 05:12:23,355 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-14 05:12:23,356 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-14 05:12:23,355 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35487,1689311513755' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-14 05:12:23,356 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43331,1689311513888' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-14 05:12:23,357 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 05:12:23,357 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:23,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:23,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:12:23,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:12:23,358 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 05:12:23,360 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 05:12:23,360 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 05:12:23,360 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 05:12:23,360 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 05:12:23,360 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 05:12:23,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:12:23,360 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 05:12:23,360 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 05:12:23,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:12:23,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 05:12:23,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:23,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:23,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:23,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:12:23,362 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:23,363 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35535,1689311513825' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-14 05:12:23,363 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7912e085[Count = 1] remaining members to acquire global barrier 2023-07-14 05:12:23,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:23,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:12:23,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:12:23,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:12:23,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:12:23,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 05:12:23,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:23,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:23,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:23,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:12:23,371 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35487,1689311513755' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-14 05:12:23,371 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7912e085[Count = 0] remaining members to acquire global barrier 2023-07-14 05:12:23,371 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-14 05:12:23,371 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 05:12:23,373 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 05:12:23,373 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 05:12:23,373 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 05:12:23,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 05:12:23,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 05:12:23,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 05:12:23,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 05:12:23,373 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-14 05:12:23,374 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:23,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 05:12:23,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 05:12:23,374 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-14 05:12:23,374 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-14 05:12:23,374 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43331,1689311513888' in zk 2023-07-14 05:12:23,374 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-14 05:12:23,374 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:23,374 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 05:12:23,377 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-14 05:12:23,377 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 05:12:23,377 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-14 05:12:23,382 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 05:12:23,385 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 05:12:23,385 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689311542250.97cf7159f42a606df117d892436af894. 2023-07-14 05:12:23,385 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689311542250.97cf7159f42a606df117d892436af894. started... 2023-07-14 05:12:23,385 INFO [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 97cf7159f42a606df117d892436af894 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-14 05:12:23,385 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 05:12:23,386 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 05:12:23,386 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689311542250.70e6e658c3a637e4f0137743b54eab1a. 2023-07-14 05:12:23,386 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689311542250.70e6e658c3a637e4f0137743b54eab1a. started... 2023-07-14 05:12:23,386 INFO [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 70e6e658c3a637e4f0137743b54eab1a 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-14 05:12:23,414 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 05:12:23,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 05:12:23,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 05:12:23,416 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 05:12:23,430 INFO [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=333 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemState/70e6e658c3a637e4f0137743b54eab1a/.tmp/cf/f029771d15e74bdbb8e22c0c78529f9a 2023-07-14 05:12:23,431 INFO [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.93 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemState/97cf7159f42a606df117d892436af894/.tmp/cf/b64e42eb8b09435a9ee8e3ce33b0e8cf 2023-07-14 05:12:23,442 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemState/70e6e658c3a637e4f0137743b54eab1a/.tmp/cf/f029771d15e74bdbb8e22c0c78529f9a as hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemState/70e6e658c3a637e4f0137743b54eab1a/cf/f029771d15e74bdbb8e22c0c78529f9a 2023-07-14 05:12:23,443 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemState/97cf7159f42a606df117d892436af894/.tmp/cf/b64e42eb8b09435a9ee8e3ce33b0e8cf as hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemState/97cf7159f42a606df117d892436af894/cf/b64e42eb8b09435a9ee8e3ce33b0e8cf 2023-07-14 05:12:23,448 INFO [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemState/70e6e658c3a637e4f0137743b54eab1a/cf/f029771d15e74bdbb8e22c0c78529f9a, entries=5, sequenceid=6, filesize=5.2 K 2023-07-14 05:12:23,451 INFO [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemState/97cf7159f42a606df117d892436af894/cf/b64e42eb8b09435a9ee8e3ce33b0e8cf, entries=45, sequenceid=6, filesize=7.9 K 2023-07-14 05:12:23,455 INFO [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 70e6e658c3a637e4f0137743b54eab1a in 69ms, sequenceid=6, compaction requested=false 2023-07-14 05:12:23,455 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-14 05:12:23,455 INFO [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 97cf7159f42a606df117d892436af894 in 70ms, sequenceid=6, compaction requested=false 2023-07-14 05:12:23,455 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-14 05:12:23,456 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 70e6e658c3a637e4f0137743b54eab1a: 2023-07-14 05:12:23,457 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 97cf7159f42a606df117d892436af894: 2023-07-14 05:12:23,458 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689311542250.70e6e658c3a637e4f0137743b54eab1a.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-14 05:12:23,458 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 05:12:23,458 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689311542250.97cf7159f42a606df117d892436af894.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-14 05:12:23,458 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemState/70e6e658c3a637e4f0137743b54eab1a/cf/f029771d15e74bdbb8e22c0c78529f9a] hfiles 2023-07-14 05:12:23,458 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 05:12:23,458 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemState/70e6e658c3a637e4f0137743b54eab1a/cf/f029771d15e74bdbb8e22c0c78529f9a for snapshot=snaptb0-testExportFileSystemState 2023-07-14 05:12:23,458 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemState/97cf7159f42a606df117d892436af894/cf/b64e42eb8b09435a9ee8e3ce33b0e8cf] hfiles 2023-07-14 05:12:23,458 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemState/97cf7159f42a606df117d892436af894/cf/b64e42eb8b09435a9ee8e3ce33b0e8cf for snapshot=snaptb0-testExportFileSystemState 2023-07-14 05:12:23,494 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689311542250.97cf7159f42a606df117d892436af894. completed. 2023-07-14 05:12:23,494 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689311542250.97cf7159f42a606df117d892436af894. 2023-07-14 05:12:23,495 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 05:12:23,495 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 05:12:23,495 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:23,495 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-14 05:12:23,495 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35535,1689311513825' in zk 2023-07-14 05:12:23,496 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689311542250.70e6e658c3a637e4f0137743b54eab1a. completed. 2023-07-14 05:12:23,496 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689311542250.70e6e658c3a637e4f0137743b54eab1a. 2023-07-14 05:12:23,496 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 05:12:23,496 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 05:12:23,496 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:23,496 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-14 05:12:23,497 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35487,1689311513755' in zk 2023-07-14 05:12:23,583 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-14 05:12:23,583 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:23,583 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 05:12:23,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:23,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:12:23,583 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-14 05:12:23,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:12:23,616 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 05:12:23,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 05:12:23,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 05:12:23,617 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 05:12:23,675 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:23,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:12:23,675 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-14 05:12:23,676 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 05:12:23,676 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-14 05:12:23,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:12:23,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 05:12:23,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:23,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:23,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:23,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:12:23,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 05:12:23,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:23,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:23,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:23,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,35535,1689311513825': 2023-07-14 05:12:23,681 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35535,1689311513825' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-14 05:12:23,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:23,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:12:23,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:12:23,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:12:23,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:12:23,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 05:12:23,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:23,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:23,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:23,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:12:23,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 05:12:23,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:23,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:23,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:23,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,35487,1689311513755': 2023-07-14 05:12:23,684 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35487,1689311513755' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-14 05:12:23,684 INFO [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-14 05:12:23,684 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 05:12:23,684 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 05:12:23,684 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-14 05:12:23,684 INFO [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 05:12:23,745 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 05:12:23,745 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 05:12:23,745 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:12:23,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 05:12:23,745 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:12:23,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 05:12:23,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 05:12:23,745 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 05:12:23,745 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 05:12:23,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 05:12:23,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 05:12:23,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:12:23,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:12:23,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 05:12:23,746 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:12:23,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 05:12:23,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:12:23,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:12:23,746 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:23,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:12:23,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:12:23,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:12:23,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:12:23,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 05:12:23,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:12:23,747 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:23,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 05:12:23,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 05:12:23,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 05:12:23,747 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:23,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:12:23,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 05:12:23,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:23,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:23,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:23,750 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:23,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:12:23,750 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:23,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 05:12:23,750 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:23,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:23,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:23,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:23,837 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:23,837 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:12:23,837 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:12:23,837 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:12:23,837 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 05:12:23,837 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:12:23,837 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-14 05:12:23,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:12:23,839 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-14 05:12:23,837 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:12:23,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:12:23,837 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 05:12:23,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:12:23,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:12:23,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:12:23,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:12:23,839 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:12:23,839 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:23,840 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:23,840 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 05:12:23,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:12:23,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:12:23,840 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:23,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:12:23,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:12:23,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:12:23,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:12:23,840 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-14 05:12:23,840 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 05:12:23,840 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:23,840 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:23,840 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 05:12:23,840 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 05:12:23,863 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-14 05:12:23,883 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-14 05:12:23,884 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-14 05:12:23,884 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-14 05:12:23,884 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689311543312Consolidate snapshot: snaptb0-testExportFileSystemState at 1689311543839 (+527 ms)Loading Region manifests for snaptb0-testExportFileSystemState at 1689311543839Writing data manifest for snaptb0-testExportFileSystemState at 1689311543843 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689311543855 (+12 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689311543883 (+28 ms) 2023-07-14 05:12:23,886 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-14 05:12:23,888 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 574 msec 2023-07-14 05:12:23,918 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 05:12:23,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 05:12:23,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 05:12:23,921 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/export-test/export-1689311543921 2023-07-14 05:12:23,921 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36535, tgtDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/export-test/export-1689311543921, rawTgtDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/export-test/export-1689311543921, srcFsUri=hdfs://localhost:36535, srcDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48 2023-07-14 05:12:23,947 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36535, inputRoot=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48 2023-07-14 05:12:23,947 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_229548280_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/export-test/export-1689311543921, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/export-test/export-1689311543921/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-14 05:12:23,947 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36535, inputRoot=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48, snapshotDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-14 05:12:23,960 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/export-test/export-1689311543921/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-14 05:12:23,993 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 05:12:23,994 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 05:12:23,994 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 05:12:23,995 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 05:12:23,995 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-14 05:12:23,995 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 05:12:23,996 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 05:12:24,067 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/hadoop-1065432885879996977.jar 2023-07-14 05:12:24,067 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 05:12:24,068 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 05:12:24,068 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 05:12:24,069 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 05:12:24,069 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 05:12:24,069 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 05:12:24,070 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 05:12:24,070 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 05:12:24,071 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 05:12:24,071 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 05:12:24,072 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 05:12:24,072 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 05:12:24,072 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 05:12:24,073 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 05:12:24,073 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 05:12:24,074 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 05:12:24,074 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 05:12:24,075 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 05:12:24,075 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 05:12:24,075 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 05:12:24,075 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 05:12:24,076 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 05:12:24,076 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 05:12:24,568 WARN [Listener at jenkins-hbase4.apache.org/38651] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 05:12:24,571 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-14 05:12:24,574 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-14 05:12:25,815 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 05:12:25,815 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 05:12:25,821 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689311521774_0001_000001 (auth:SIMPLE) 2023-07-14 05:12:26,205 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689311521774_0002_000001 (auth:SIMPLE) 2023-07-14 05:12:27,530 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 05:12:31,075 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689311521774_0002_000001 (auth:SIMPLE) 2023-07-14 05:12:33,300 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689311521774_0002_000001 (auth:SIMPLE) 2023-07-14 05:12:36,116 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689311521774_0002_000001 (auth:SIMPLE) 2023-07-14 05:12:37,806 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 05:12:37,807 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 05:12:37,814 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-14 05:12:37,814 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 05:12:37,815 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 05:12:37,815 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-839015254_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-14 05:12:37,815 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(367): hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-14 05:12:37,815 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(367): hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-14 05:12:37,815 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-839015254_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/export-test/export-1689311543921/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/export-test/export-1689311543921/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-14 05:12:37,816 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(367): hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/export-test/export-1689311543921/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-14 05:12:37,816 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(367): hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/export-test/export-1689311543921/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-14 05:12:37,822 INFO [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-14 05:12:37,823 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-14 05:12:37,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-14 05:12:37,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-14 05:12:37,828 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689311557828"}]},"ts":"1689311557828"} 2023-07-14 05:12:37,829 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-14 05:12:37,831 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-14 05:12:37,832 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=70e6e658c3a637e4f0137743b54eab1a, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=97cf7159f42a606df117d892436af894, UNASSIGN}] 2023-07-14 05:12:37,834 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=97cf7159f42a606df117d892436af894, UNASSIGN 2023-07-14 05:12:37,834 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=70e6e658c3a637e4f0137743b54eab1a, UNASSIGN 2023-07-14 05:12:37,835 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=97cf7159f42a606df117d892436af894, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:37,835 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=70e6e658c3a637e4f0137743b54eab1a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:37,836 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689311542250.97cf7159f42a606df117d892436af894.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689311557835"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689311557835"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689311557835"}]},"ts":"1689311557835"} 2023-07-14 05:12:37,836 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689311542250.70e6e658c3a637e4f0137743b54eab1a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689311557835"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689311557835"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689311557835"}]},"ts":"1689311557835"} 2023-07-14 05:12:37,837 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure 97cf7159f42a606df117d892436af894, server=jenkins-hbase4.apache.org,35535,1689311513825}] 2023-07-14 05:12:37,838 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure 70e6e658c3a637e4f0137743b54eab1a, server=jenkins-hbase4.apache.org,35487,1689311513755}] 2023-07-14 05:12:37,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-14 05:12:37,990 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 97cf7159f42a606df117d892436af894 2023-07-14 05:12:37,990 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 97cf7159f42a606df117d892436af894, disabling compactions & flushes 2023-07-14 05:12:37,990 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689311542250.97cf7159f42a606df117d892436af894. 2023-07-14 05:12:37,990 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689311542250.97cf7159f42a606df117d892436af894. 2023-07-14 05:12:37,990 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689311542250.97cf7159f42a606df117d892436af894. after waiting 0 ms 2023-07-14 05:12:37,990 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689311542250.97cf7159f42a606df117d892436af894. 2023-07-14 05:12:37,991 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 70e6e658c3a637e4f0137743b54eab1a 2023-07-14 05:12:37,994 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 70e6e658c3a637e4f0137743b54eab1a, disabling compactions & flushes 2023-07-14 05:12:37,994 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689311542250.70e6e658c3a637e4f0137743b54eab1a. 2023-07-14 05:12:37,994 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689311542250.70e6e658c3a637e4f0137743b54eab1a. 2023-07-14 05:12:37,994 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689311542250.70e6e658c3a637e4f0137743b54eab1a. after waiting 0 ms 2023-07-14 05:12:37,994 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689311542250.70e6e658c3a637e4f0137743b54eab1a. 2023-07-14 05:12:38,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemState/97cf7159f42a606df117d892436af894/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 05:12:38,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemState/70e6e658c3a637e4f0137743b54eab1a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 05:12:38,008 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 05:12:38,009 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 05:12:38,009 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689311542250.97cf7159f42a606df117d892436af894. 2023-07-14 05:12:38,009 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689311542250.70e6e658c3a637e4f0137743b54eab1a. 2023-07-14 05:12:38,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 97cf7159f42a606df117d892436af894: 2023-07-14 05:12:38,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 70e6e658c3a637e4f0137743b54eab1a: 2023-07-14 05:12:38,011 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 97cf7159f42a606df117d892436af894 2023-07-14 05:12:38,012 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=97cf7159f42a606df117d892436af894, regionState=CLOSED 2023-07-14 05:12:38,012 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 70e6e658c3a637e4f0137743b54eab1a 2023-07-14 05:12:38,012 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689311542250.97cf7159f42a606df117d892436af894.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689311558012"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689311558012"}]},"ts":"1689311558012"} 2023-07-14 05:12:38,013 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=70e6e658c3a637e4f0137743b54eab1a, regionState=CLOSED 2023-07-14 05:12:38,013 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689311542250.70e6e658c3a637e4f0137743b54eab1a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689311558013"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689311558013"}]},"ts":"1689311558013"} 2023-07-14 05:12:38,016 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=38 2023-07-14 05:12:38,016 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure 97cf7159f42a606df117d892436af894, server=jenkins-hbase4.apache.org,35535,1689311513825 in 177 msec 2023-07-14 05:12:38,016 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=37 2023-07-14 05:12:38,017 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure 70e6e658c3a637e4f0137743b54eab1a, server=jenkins-hbase4.apache.org,35487,1689311513755 in 177 msec 2023-07-14 05:12:38,017 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=97cf7159f42a606df117d892436af894, UNASSIGN in 184 msec 2023-07-14 05:12:38,018 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-14 05:12:38,019 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=70e6e658c3a637e4f0137743b54eab1a, UNASSIGN in 185 msec 2023-07-14 05:12:38,019 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689311558019"}]},"ts":"1689311558019"} 2023-07-14 05:12:38,020 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-14 05:12:38,023 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-14 05:12:38,025 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 201 msec 2023-07-14 05:12:38,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-14 05:12:38,130 INFO [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-14 05:12:38,131 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-14 05:12:38,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-14 05:12:38,135 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-14 05:12:38,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-14 05:12:38,136 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-14 05:12:38,137 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35487] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-14 05:12:38,140 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 05:12:38,140 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 05:12:38,140 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 05:12:38,140 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 05:12:38,140 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-14 05:12:38,140 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-14 05:12:38,140 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-14 05:12:38,141 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-14 05:12:38,142 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 05:12:38,142 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 05:12:38,142 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 05:12:38,142 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 05:12:38,142 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 05:12:38,142 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemState/97cf7159f42a606df117d892436af894 2023-07-14 05:12:38,142 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 05:12:38,142 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 05:12:38,142 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 05:12:38,142 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemState/70e6e658c3a637e4f0137743b54eab1a 2023-07-14 05:12:38,145 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemState/97cf7159f42a606df117d892436af894/cf, FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemState/97cf7159f42a606df117d892436af894/recovered.edits] 2023-07-14 05:12:38,145 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemState/70e6e658c3a637e4f0137743b54eab1a/cf, FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemState/70e6e658c3a637e4f0137743b54eab1a/recovered.edits] 2023-07-14 05:12:38,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-14 05:12:38,156 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemState/70e6e658c3a637e4f0137743b54eab1a/cf/f029771d15e74bdbb8e22c0c78529f9a to hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/archive/data/default/testtb-testExportFileSystemState/70e6e658c3a637e4f0137743b54eab1a/cf/f029771d15e74bdbb8e22c0c78529f9a 2023-07-14 05:12:38,159 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemState/97cf7159f42a606df117d892436af894/cf/b64e42eb8b09435a9ee8e3ce33b0e8cf to hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/archive/data/default/testtb-testExportFileSystemState/97cf7159f42a606df117d892436af894/cf/b64e42eb8b09435a9ee8e3ce33b0e8cf 2023-07-14 05:12:38,163 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemState/97cf7159f42a606df117d892436af894/recovered.edits/9.seqid to hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/archive/data/default/testtb-testExportFileSystemState/97cf7159f42a606df117d892436af894/recovered.edits/9.seqid 2023-07-14 05:12:38,164 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemState/97cf7159f42a606df117d892436af894 2023-07-14 05:12:38,165 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemState/70e6e658c3a637e4f0137743b54eab1a/recovered.edits/9.seqid to hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/archive/data/default/testtb-testExportFileSystemState/70e6e658c3a637e4f0137743b54eab1a/recovered.edits/9.seqid 2023-07-14 05:12:38,166 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemState/70e6e658c3a637e4f0137743b54eab1a 2023-07-14 05:12:38,167 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-14 05:12:38,170 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-14 05:12:38,198 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-14 05:12:38,201 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-14 05:12:38,203 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-14 05:12:38,203 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-14 05:12:38,203 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689311542250.70e6e658c3a637e4f0137743b54eab1a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689311558203"}]},"ts":"9223372036854775807"} 2023-07-14 05:12:38,203 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689311542250.97cf7159f42a606df117d892436af894.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689311558203"}]},"ts":"9223372036854775807"} 2023-07-14 05:12:38,205 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-14 05:12:38,205 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 70e6e658c3a637e4f0137743b54eab1a, NAME => 'testtb-testExportFileSystemState,,1689311542250.70e6e658c3a637e4f0137743b54eab1a.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 97cf7159f42a606df117d892436af894, NAME => 'testtb-testExportFileSystemState,1,1689311542250.97cf7159f42a606df117d892436af894.', STARTKEY => '1', ENDKEY => ''}] 2023-07-14 05:12:38,205 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-14 05:12:38,206 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689311558205"}]},"ts":"9223372036854775807"} 2023-07-14 05:12:38,208 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-14 05:12:38,210 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-14 05:12:38,214 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 79 msec 2023-07-14 05:12:38,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-14 05:12:38,253 INFO [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-14 05:12:38,263 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-14 05:12:38,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-14 05:12:38,268 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-14 05:12:38,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-14 05:12:38,305 INFO [Listener at jenkins-hbase4.apache.org/38651] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=767 (was 752) Potentially hanging thread: hconnection-0x11720e3f-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x11720e3f-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-839015254_17 at /127.0.0.1:53300 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (145847449) connection to jenkins-hbase4.apache.org/172.31.14.131:34369 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x11720e3f-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x11720e3f-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1947 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-839015254_17 at /127.0.0.1:38342 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-839015254_17 at /127.0.0.1:46600 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-521503387_1 at /127.0.0.1:46580 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=917 (was 916) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=295 (was 252) - SystemLoadAverage LEAK? -, ProcessCount=182 (was 181) - ProcessCount LEAK? -, AvailableMemoryMB=3736 (was 3903) 2023-07-14 05:12:38,305 WARN [Listener at jenkins-hbase4.apache.org/38651] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-07-14 05:12:38,325 INFO [Listener at jenkins-hbase4.apache.org/38651] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=767, OpenFileDescriptor=917, MaxFileDescriptor=60000, SystemLoadAverage=295, ProcessCount=182, AvailableMemoryMB=3736 2023-07-14 05:12:38,325 WARN [Listener at jenkins-hbase4.apache.org/38651] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-07-14 05:12:38,327 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-14 05:12:38,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-14 05:12:38,331 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 05:12:38,332 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-14 05:12:38,333 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 05:12:38,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-14 05:12:38,335 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testConsecutiveExports/d2301b45cccde46626cc7815b283cf3a 2023-07-14 05:12:38,336 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testConsecutiveExports/d2301b45cccde46626cc7815b283cf3a empty. 2023-07-14 05:12:38,336 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testConsecutiveExports/9798a4e82be50287a43cb1ad8a9c5b0a 2023-07-14 05:12:38,337 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testConsecutiveExports/d2301b45cccde46626cc7815b283cf3a 2023-07-14 05:12:38,337 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testConsecutiveExports/9798a4e82be50287a43cb1ad8a9c5b0a empty. 2023-07-14 05:12:38,337 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testConsecutiveExports/9798a4e82be50287a43cb1ad8a9c5b0a 2023-07-14 05:12:38,337 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-14 05:12:38,381 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-14 05:12:38,383 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => d2301b45cccde46626cc7815b283cf3a, NAME => 'testtb-testConsecutiveExports,,1689311558327.d2301b45cccde46626cc7815b283cf3a.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp 2023-07-14 05:12:38,391 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 9798a4e82be50287a43cb1ad8a9c5b0a, NAME => 'testtb-testConsecutiveExports,1,1689311558327.9798a4e82be50287a43cb1ad8a9c5b0a.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp 2023-07-14 05:12:38,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-14 05:12:38,458 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689311558327.d2301b45cccde46626cc7815b283cf3a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 05:12:38,458 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing d2301b45cccde46626cc7815b283cf3a, disabling compactions & flushes 2023-07-14 05:12:38,458 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689311558327.d2301b45cccde46626cc7815b283cf3a. 2023-07-14 05:12:38,458 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689311558327.d2301b45cccde46626cc7815b283cf3a. 2023-07-14 05:12:38,459 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689311558327.d2301b45cccde46626cc7815b283cf3a. after waiting 0 ms 2023-07-14 05:12:38,459 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689311558327.d2301b45cccde46626cc7815b283cf3a. 2023-07-14 05:12:38,459 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689311558327.d2301b45cccde46626cc7815b283cf3a. 2023-07-14 05:12:38,459 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for d2301b45cccde46626cc7815b283cf3a: 2023-07-14 05:12:38,459 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689311558327.9798a4e82be50287a43cb1ad8a9c5b0a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 05:12:38,460 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 9798a4e82be50287a43cb1ad8a9c5b0a, disabling compactions & flushes 2023-07-14 05:12:38,460 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689311558327.9798a4e82be50287a43cb1ad8a9c5b0a. 2023-07-14 05:12:38,460 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689311558327.9798a4e82be50287a43cb1ad8a9c5b0a. 2023-07-14 05:12:38,460 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689311558327.9798a4e82be50287a43cb1ad8a9c5b0a. after waiting 0 ms 2023-07-14 05:12:38,460 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689311558327.9798a4e82be50287a43cb1ad8a9c5b0a. 2023-07-14 05:12:38,460 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689311558327.9798a4e82be50287a43cb1ad8a9c5b0a. 2023-07-14 05:12:38,460 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 9798a4e82be50287a43cb1ad8a9c5b0a: 2023-07-14 05:12:38,463 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 05:12:38,464 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689311558327.d2301b45cccde46626cc7815b283cf3a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689311558464"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689311558464"}]},"ts":"1689311558464"} 2023-07-14 05:12:38,464 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689311558327.9798a4e82be50287a43cb1ad8a9c5b0a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689311558464"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689311558464"}]},"ts":"1689311558464"} 2023-07-14 05:12:38,466 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 05:12:38,467 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 05:12:38,468 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689311558468"}]},"ts":"1689311558468"} 2023-07-14 05:12:38,469 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-14 05:12:38,473 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-14 05:12:38,474 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 05:12:38,474 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 05:12:38,474 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 05:12:38,474 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 05:12:38,474 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d2301b45cccde46626cc7815b283cf3a, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9798a4e82be50287a43cb1ad8a9c5b0a, ASSIGN}] 2023-07-14 05:12:38,477 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9798a4e82be50287a43cb1ad8a9c5b0a, ASSIGN 2023-07-14 05:12:38,477 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d2301b45cccde46626cc7815b283cf3a, ASSIGN 2023-07-14 05:12:38,477 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9798a4e82be50287a43cb1ad8a9c5b0a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43331,1689311513888; forceNewPlan=false, retain=false 2023-07-14 05:12:38,477 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d2301b45cccde46626cc7815b283cf3a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35535,1689311513825; forceNewPlan=false, retain=false 2023-07-14 05:12:38,628 INFO [jenkins-hbase4:35845] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 05:12:38,630 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=9798a4e82be50287a43cb1ad8a9c5b0a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:38,630 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=d2301b45cccde46626cc7815b283cf3a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:38,631 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689311558327.9798a4e82be50287a43cb1ad8a9c5b0a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689311558630"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689311558630"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689311558630"}]},"ts":"1689311558630"} 2023-07-14 05:12:38,631 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689311558327.d2301b45cccde46626cc7815b283cf3a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689311558630"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689311558630"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689311558630"}]},"ts":"1689311558630"} 2023-07-14 05:12:38,633 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure 9798a4e82be50287a43cb1ad8a9c5b0a, server=jenkins-hbase4.apache.org,43331,1689311513888}] 2023-07-14 05:12:38,634 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure d2301b45cccde46626cc7815b283cf3a, server=jenkins-hbase4.apache.org,35535,1689311513825}] 2023-07-14 05:12:38,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-14 05:12:38,794 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689311558327.9798a4e82be50287a43cb1ad8a9c5b0a. 2023-07-14 05:12:38,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9798a4e82be50287a43cb1ad8a9c5b0a, NAME => 'testtb-testConsecutiveExports,1,1689311558327.9798a4e82be50287a43cb1ad8a9c5b0a.', STARTKEY => '1', ENDKEY => ''} 2023-07-14 05:12:38,795 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689311558327.d2301b45cccde46626cc7815b283cf3a. 2023-07-14 05:12:38,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d2301b45cccde46626cc7815b283cf3a, NAME => 'testtb-testConsecutiveExports,,1689311558327.d2301b45cccde46626cc7815b283cf3a.', STARTKEY => '', ENDKEY => '1'} 2023-07-14 05:12:38,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689311558327.9798a4e82be50287a43cb1ad8a9c5b0a. service=AccessControlService 2023-07-14 05:12:38,795 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 05:12:38,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689311558327.d2301b45cccde46626cc7815b283cf3a. service=AccessControlService 2023-07-14 05:12:38,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 9798a4e82be50287a43cb1ad8a9c5b0a 2023-07-14 05:12:38,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689311558327.9798a4e82be50287a43cb1ad8a9c5b0a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 05:12:38,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9798a4e82be50287a43cb1ad8a9c5b0a 2023-07-14 05:12:38,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9798a4e82be50287a43cb1ad8a9c5b0a 2023-07-14 05:12:38,795 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 05:12:38,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports d2301b45cccde46626cc7815b283cf3a 2023-07-14 05:12:38,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689311558327.d2301b45cccde46626cc7815b283cf3a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 05:12:38,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d2301b45cccde46626cc7815b283cf3a 2023-07-14 05:12:38,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d2301b45cccde46626cc7815b283cf3a 2023-07-14 05:12:38,798 INFO [StoreOpener-9798a4e82be50287a43cb1ad8a9c5b0a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9798a4e82be50287a43cb1ad8a9c5b0a 2023-07-14 05:12:38,798 INFO [StoreOpener-d2301b45cccde46626cc7815b283cf3a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d2301b45cccde46626cc7815b283cf3a 2023-07-14 05:12:38,799 DEBUG [StoreOpener-9798a4e82be50287a43cb1ad8a9c5b0a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testConsecutiveExports/9798a4e82be50287a43cb1ad8a9c5b0a/cf 2023-07-14 05:12:38,799 DEBUG [StoreOpener-9798a4e82be50287a43cb1ad8a9c5b0a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testConsecutiveExports/9798a4e82be50287a43cb1ad8a9c5b0a/cf 2023-07-14 05:12:38,799 DEBUG [StoreOpener-d2301b45cccde46626cc7815b283cf3a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testConsecutiveExports/d2301b45cccde46626cc7815b283cf3a/cf 2023-07-14 05:12:38,800 DEBUG [StoreOpener-d2301b45cccde46626cc7815b283cf3a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testConsecutiveExports/d2301b45cccde46626cc7815b283cf3a/cf 2023-07-14 05:12:38,800 INFO [StoreOpener-9798a4e82be50287a43cb1ad8a9c5b0a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9798a4e82be50287a43cb1ad8a9c5b0a columnFamilyName cf 2023-07-14 05:12:38,800 INFO [StoreOpener-d2301b45cccde46626cc7815b283cf3a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d2301b45cccde46626cc7815b283cf3a columnFamilyName cf 2023-07-14 05:12:38,800 INFO [StoreOpener-9798a4e82be50287a43cb1ad8a9c5b0a-1] regionserver.HStore(310): Store=9798a4e82be50287a43cb1ad8a9c5b0a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 05:12:38,801 INFO [StoreOpener-d2301b45cccde46626cc7815b283cf3a-1] regionserver.HStore(310): Store=d2301b45cccde46626cc7815b283cf3a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 05:12:38,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testConsecutiveExports/9798a4e82be50287a43cb1ad8a9c5b0a 2023-07-14 05:12:38,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testConsecutiveExports/d2301b45cccde46626cc7815b283cf3a 2023-07-14 05:12:38,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testConsecutiveExports/9798a4e82be50287a43cb1ad8a9c5b0a 2023-07-14 05:12:38,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testConsecutiveExports/d2301b45cccde46626cc7815b283cf3a 2023-07-14 05:12:38,805 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d2301b45cccde46626cc7815b283cf3a 2023-07-14 05:12:38,805 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9798a4e82be50287a43cb1ad8a9c5b0a 2023-07-14 05:12:38,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testConsecutiveExports/d2301b45cccde46626cc7815b283cf3a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 05:12:38,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testConsecutiveExports/9798a4e82be50287a43cb1ad8a9c5b0a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 05:12:38,811 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d2301b45cccde46626cc7815b283cf3a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72569444, jitterRate=0.08136898279190063}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 05:12:38,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d2301b45cccde46626cc7815b283cf3a: 2023-07-14 05:12:38,811 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9798a4e82be50287a43cb1ad8a9c5b0a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66934258, jitterRate=-0.002601832151412964}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 05:12:38,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9798a4e82be50287a43cb1ad8a9c5b0a: 2023-07-14 05:12:38,812 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689311558327.d2301b45cccde46626cc7815b283cf3a., pid=46, masterSystemTime=1689311558786 2023-07-14 05:12:38,814 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689311558327.9798a4e82be50287a43cb1ad8a9c5b0a., pid=45, masterSystemTime=1689311558785 2023-07-14 05:12:38,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689311558327.d2301b45cccde46626cc7815b283cf3a. 2023-07-14 05:12:38,814 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689311558327.d2301b45cccde46626cc7815b283cf3a. 2023-07-14 05:12:38,815 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=d2301b45cccde46626cc7815b283cf3a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:38,815 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689311558327.d2301b45cccde46626cc7815b283cf3a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689311558815"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689311558815"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689311558815"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689311558815"}]},"ts":"1689311558815"} 2023-07-14 05:12:38,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689311558327.9798a4e82be50287a43cb1ad8a9c5b0a. 2023-07-14 05:12:38,815 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689311558327.9798a4e82be50287a43cb1ad8a9c5b0a. 2023-07-14 05:12:38,816 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=9798a4e82be50287a43cb1ad8a9c5b0a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:38,816 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689311558327.9798a4e82be50287a43cb1ad8a9c5b0a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689311558816"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689311558816"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689311558816"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689311558816"}]},"ts":"1689311558816"} 2023-07-14 05:12:38,819 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-14 05:12:38,819 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure d2301b45cccde46626cc7815b283cf3a, server=jenkins-hbase4.apache.org,35535,1689311513825 in 183 msec 2023-07-14 05:12:38,821 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-14 05:12:38,821 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure 9798a4e82be50287a43cb1ad8a9c5b0a, server=jenkins-hbase4.apache.org,43331,1689311513888 in 185 msec 2023-07-14 05:12:38,821 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d2301b45cccde46626cc7815b283cf3a, ASSIGN in 345 msec 2023-07-14 05:12:38,823 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-07-14 05:12:38,823 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9798a4e82be50287a43cb1ad8a9c5b0a, ASSIGN in 347 msec 2023-07-14 05:12:38,824 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 05:12:38,824 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689311558824"}]},"ts":"1689311558824"} 2023-07-14 05:12:38,825 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-14 05:12:38,827 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 05:12:38,828 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-14 05:12:38,829 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35487] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-14 05:12:38,832 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 05:12:38,832 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 05:12:38,832 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 05:12:38,832 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 05:12:38,834 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-14 05:12:38,834 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-14 05:12:38,834 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-14 05:12:38,834 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-14 05:12:38,836 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 507 msec 2023-07-14 05:12:38,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-14 05:12:38,940 INFO [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-14 05:12:38,940 DEBUG [Listener at jenkins-hbase4.apache.org/38651] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testConsecutiveExports get assigned. Timeout = 60000ms 2023-07-14 05:12:38,941 INFO [Listener at jenkins-hbase4.apache.org/38651] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 05:12:38,944 INFO [Listener at jenkins-hbase4.apache.org/38651] hbase.HBaseTestingUtility(3484): All regions for table testtb-testConsecutiveExports assigned to meta. Checking AM states. 2023-07-14 05:12:38,945 INFO [Listener at jenkins-hbase4.apache.org/38651] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 05:12:38,945 INFO [Listener at jenkins-hbase4.apache.org/38651] hbase.HBaseTestingUtility(3504): All regions for table testtb-testConsecutiveExports assigned. 2023-07-14 05:12:38,948 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-14 05:12:38,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689311558948 (current time:1689311558948). 2023-07-14 05:12:38,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 05:12:38,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] zookeeper.ReadOnlyZKClient(139): Connect 0x1be617f5 to 127.0.0.1:55310 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 05:12:38,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7af7a12b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 05:12:38,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 05:12:38,958 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46394, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 05:12:38,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1be617f5 to 127.0.0.1:55310 2023-07-14 05:12:38,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 05:12:38,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] zookeeper.ReadOnlyZKClient(139): Connect 0x32286017 to 127.0.0.1:55310 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 05:12:38,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e0fbcd0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 05:12:38,968 DEBUG [hconnection-0x3936b4c3-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 05:12:38,970 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46400, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 05:12:38,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 05:12:38,976 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55722, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 05:12:38,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x32286017 to 127.0.0.1:55310 2023-07-14 05:12:38,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 05:12:38,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-14 05:12:38,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 05:12:38,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-14 05:12:38,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-14 05:12:38,981 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-14 05:12:38,982 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689312158982 2023-07-14 05:12:38,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-14 05:12:38,982 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-14 05:12:38,983 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 05:12:38,983 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 05:12:38,986 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-14 05:12:38,986 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-14 05:12:38,987 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-07-14 05:12:38,988 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-14 05:12:38,989 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689312158989 2023-07-14 05:12:39,007 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,007 INFO [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-14 05:12:39,007 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 05:12:39,008 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-14 05:12:39,008 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-14 05:12:39,008 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,008 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,009 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:39,009 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:12:39,010 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:12:39,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:12:39,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:12:39,009 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:12:39,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:12:39,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:12:39,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:12:39,010 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:39,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:12:39,010 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:39,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,011 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:39,011 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,011 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,011 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,011 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 05:12:39,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-14 05:12:39,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-14 05:12:39,011 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-14 05:12:39,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-14 05:12:39,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,012 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,012 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-14 05:12:39,012 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-14 05:12:39,012 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 05:12:39,012 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-14 05:12:39,013 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-14 05:12:39,013 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,013 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-14 05:12:39,013 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,013 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-14 05:12:39,013 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35535,1689311513825' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-14 05:12:39,013 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 05:12:39,013 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-14 05:12:39,014 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 05:12:39,014 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-14 05:12:39,017 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-14 05:12:39,017 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-14 05:12:39,017 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-14 05:12:39,017 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43331,1689311513888' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-14 05:12:39,017 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35487,1689311513755' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-14 05:12:39,018 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:39,018 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:39,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:12:39,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:12:39,020 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,020 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:39,020 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:12:39,021 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,021 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 05:12:39,021 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,021 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 05:12:39,021 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,021 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 05:12:39,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:12:39,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:39,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:39,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:39,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:12:39,023 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35535,1689311513825' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-14 05:12:39,023 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5641d78b[Count = 1] remaining members to acquire global barrier 2023-07-14 05:12:39,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:39,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:12:39,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:12:39,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:12:39,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:12:39,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:39,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:39,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:39,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:12:39,025 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43331,1689311513888' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-14 05:12:39,026 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5641d78b[Count = 0] remaining members to acquire global barrier 2023-07-14 05:12:39,026 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-14 05:12:39,026 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,027 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,027 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,027 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,027 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:39,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,027 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-14 05:12:39,027 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-14 05:12:39,027 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-14 05:12:39,027 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35487,1689311513755' in zk 2023-07-14 05:12:39,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,027 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:39,027 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689311558327.d2301b45cccde46626cc7815b283cf3a. 2023-07-14 05:12:39,027 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 05:12:39,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,027 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 05:12:39,028 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 05:12:39,027 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-14 05:12:39,027 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689311558327.d2301b45cccde46626cc7815b283cf3a. started... 2023-07-14 05:12:39,029 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 05:12:39,029 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 05:12:39,029 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d2301b45cccde46626cc7815b283cf3a: 2023-07-14 05:12:39,029 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689311558327.9798a4e82be50287a43cb1ad8a9c5b0a. 2023-07-14 05:12:39,030 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689311558327.9798a4e82be50287a43cb1ad8a9c5b0a. started... 2023-07-14 05:12:39,030 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689311558327.d2301b45cccde46626cc7815b283cf3a.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,030 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9798a4e82be50287a43cb1ad8a9c5b0a: 2023-07-14 05:12:39,030 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 05:12:39,031 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 05:12:39,031 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689311558327.9798a4e82be50287a43cb1ad8a9c5b0a.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,032 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 05:12:39,032 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 05:12:39,037 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-14 05:12:39,037 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 05:12:39,037 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-14 05:12:39,063 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689311558327.9798a4e82be50287a43cb1ad8a9c5b0a. completed. 2023-07-14 05:12:39,063 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689311558327.9798a4e82be50287a43cb1ad8a9c5b0a. 2023-07-14 05:12:39,063 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 05:12:39,063 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 05:12:39,063 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:39,063 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-14 05:12:39,063 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43331,1689311513888' in zk 2023-07-14 05:12:39,066 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-14 05:12:39,066 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 05:12:39,066 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-14 05:12:39,067 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:39,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:39,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:12:39,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:12:39,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:12:39,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:12:39,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:39,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:39,070 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689311558327.d2301b45cccde46626cc7815b283cf3a. completed. 2023-07-14 05:12:39,070 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689311558327.d2301b45cccde46626cc7815b283cf3a. 2023-07-14 05:12:39,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:39,070 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 05:12:39,071 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 05:12:39,071 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:39,071 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-14 05:12:39,071 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35535,1689311513825' in zk 2023-07-14 05:12:39,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:12:39,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,072 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:39,073 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-14 05:12:39,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:39,073 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 05:12:39,073 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-14 05:12:39,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:39,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:39,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,43331,1689311513888': 2023-07-14 05:12:39,076 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43331,1689311513888' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-14 05:12:39,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:39,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:12:39,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:12:39,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:12:39,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:12:39,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:39,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:39,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:39,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:12:39,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:39,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:39,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:39,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,35535,1689311513825': 2023-07-14 05:12:39,082 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35535,1689311513825' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-14 05:12:39,082 INFO [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-14 05:12:39,082 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 05:12:39,082 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 05:12:39,082 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,082 INFO [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 05:12:39,083 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 05:12:39,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-14 05:12:39,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-14 05:12:39,084 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 05:12:39,085 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,085 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,085 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:12:39,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,085 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:12:39,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:12:39,085 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:12:39,085 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:12:39,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,085 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:12:39,086 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:39,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:12:39,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:12:39,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:12:39,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:12:39,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:12:39,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:12:39,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,087 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:39,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:12:39,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,088 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:39,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:39,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:39,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:39,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:12:39,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,094 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:39,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:39,094 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:39,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:39,095 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:39,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:39,097 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:39,097 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,097 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:39,097 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:12:39,097 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:12:39,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:12:39,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:12:39,097 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:12:39,098 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,097 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:12:39,098 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,097 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 05:12:39,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:12:39,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:12:39,097 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:12:39,097 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:39,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:12:39,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:12:39,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:12:39,098 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:12:39,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:12:39,099 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,100 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:39,100 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,100 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:39,100 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:39,100 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,100 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,100 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:12:39,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:12:39,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:12:39,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:12:39,121 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,143 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-14 05:12:39,143 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,144 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-14 05:12:39,144 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689311558982Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689311559098 (+116 ms)Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689311559098Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689311559103 (+5 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689311559115 (+12 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689311559143 (+28 ms) 2023-07-14 05:12:39,146 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-14 05:12:39,148 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 163 msec 2023-07-14 05:12:39,285 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 05:12:39,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-14 05:12:39,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 05:12:39,298 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35535] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689311558327.d2301b45cccde46626cc7815b283cf3a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 05:12:39,302 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43331] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689311558327.9798a4e82be50287a43cb1ad8a9c5b0a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 05:12:39,306 DEBUG [Listener at jenkins-hbase4.apache.org/38651] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-14 05:12:39,306 DEBUG [Listener at jenkins-hbase4.apache.org/38651] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689311558327.d2301b45cccde46626cc7815b283cf3a. 2023-07-14 05:12:39,308 INFO [Listener at jenkins-hbase4.apache.org/38651] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 05:12:39,325 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-14 05:12:39,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689311559325 (current time:1689311559325). 2023-07-14 05:12:39,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 05:12:39,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] zookeeper.ReadOnlyZKClient(139): Connect 0x2d3195b3 to 127.0.0.1:55310 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 05:12:39,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@34b0d1a4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 05:12:39,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 05:12:39,367 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46404, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 05:12:39,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2d3195b3 to 127.0.0.1:55310 2023-07-14 05:12:39,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 05:12:39,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] zookeeper.ReadOnlyZKClient(139): Connect 0x59a4cd72 to 127.0.0.1:55310 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 05:12:39,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@789947f8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 05:12:39,408 DEBUG [hconnection-0x4a1684be-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 05:12:39,409 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46410, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 05:12:39,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 05:12:39,422 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55738, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 05:12:39,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x59a4cd72 to 127.0.0.1:55310 2023-07-14 05:12:39,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 05:12:39,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-14 05:12:39,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 05:12:39,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-14 05:12:39,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-14 05:12:39,430 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-14 05:12:39,431 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689312159431 2023-07-14 05:12:39,431 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-14 05:12:39,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-14 05:12:39,432 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 05:12:39,433 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 05:12:39,433 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-14 05:12:39,434 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-14 05:12:39,435 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-07-14 05:12:39,436 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-14 05:12:39,437 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689312159437 2023-07-14 05:12:39,467 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-14 05:12:39,467 INFO [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-14 05:12:39,467 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 05:12:39,469 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-14 05:12:39,469 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-14 05:12:39,471 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 05:12:39,471 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 05:12:39,473 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:39,473 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:12:39,473 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:12:39,473 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:12:39,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:12:39,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:12:39,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:12:39,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:12:39,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:12:39,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:12:39,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 05:12:39,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 05:12:39,475 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:39,475 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:39,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 05:12:39,475 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 05:12:39,475 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 05:12:39,476 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 05:12:39,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-14 05:12:39,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 05:12:39,476 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-14 05:12:39,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-14 05:12:39,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-14 05:12:39,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 05:12:39,477 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-14 05:12:39,476 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-14 05:12:39,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 05:12:39,477 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-14 05:12:39,477 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-14 05:12:39,477 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-14 05:12:39,477 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 05:12:39,476 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:39,477 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 05:12:39,477 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-14 05:12:39,478 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 05:12:39,479 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-14 05:12:39,479 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-14 05:12:39,479 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 05:12:39,481 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-14 05:12:39,481 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-14 05:12:39,481 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35535,1689311513825' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-14 05:12:39,481 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-14 05:12:39,481 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-14 05:12:39,481 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43331,1689311513888' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-14 05:12:39,481 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-14 05:12:39,481 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-14 05:12:39,481 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35487,1689311513755' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-14 05:12:39,488 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:39,488 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 05:12:39,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:39,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:12:39,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:12:39,488 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 05:12:39,488 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:39,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:12:39,490 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 05:12:39,490 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 05:12:39,490 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 05:12:39,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:12:39,491 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 05:12:39,491 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 05:12:39,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 05:12:39,491 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 05:12:39,491 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 05:12:39,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:39,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:39,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:39,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:12:39,494 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43331,1689311513888' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-14 05:12:39,494 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2242b14c[Count = 1] remaining members to acquire global barrier 2023-07-14 05:12:39,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:39,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:12:39,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:12:39,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:12:39,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:12:39,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 05:12:39,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:39,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:39,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:39,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:12:39,498 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35535,1689311513825' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-14 05:12:39,498 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2242b14c[Count = 0] remaining members to acquire global barrier 2023-07-14 05:12:39,498 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-14 05:12:39,498 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 05:12:39,501 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 05:12:39,501 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 05:12:39,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 05:12:39,501 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 05:12:39,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 05:12:39,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 05:12:39,501 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-14 05:12:39,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 05:12:39,501 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-14 05:12:39,501 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-14 05:12:39,501 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35487,1689311513755' in zk 2023-07-14 05:12:39,501 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:39,501 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:39,502 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 05:12:39,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 05:12:39,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 05:12:39,502 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-14 05:12:39,503 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-14 05:12:39,503 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 05:12:39,503 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-14 05:12:39,505 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 05:12:39,511 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689311558327.9798a4e82be50287a43cb1ad8a9c5b0a. 2023-07-14 05:12:39,511 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 05:12:39,511 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689311558327.d2301b45cccde46626cc7815b283cf3a. 2023-07-14 05:12:39,511 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689311558327.d2301b45cccde46626cc7815b283cf3a. started... 2023-07-14 05:12:39,510 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 05:12:39,511 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 05:12:39,511 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689311558327.9798a4e82be50287a43cb1ad8a9c5b0a. started... 2023-07-14 05:12:39,511 INFO [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d2301b45cccde46626cc7815b283cf3a 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-14 05:12:39,511 INFO [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9798a4e82be50287a43cb1ad8a9c5b0a 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-14 05:12:39,533 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 05:12:39,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-14 05:12:39,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-14 05:12:39,534 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 05:12:39,551 INFO [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.93 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testConsecutiveExports/9798a4e82be50287a43cb1ad8a9c5b0a/.tmp/cf/62b91bc7a6004c918ed2922a4646fbbf 2023-07-14 05:12:39,551 INFO [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=333 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testConsecutiveExports/d2301b45cccde46626cc7815b283cf3a/.tmp/cf/bb83d7e09d694c128fb9e1b98c1af1b8 2023-07-14 05:12:39,561 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testConsecutiveExports/d2301b45cccde46626cc7815b283cf3a/.tmp/cf/bb83d7e09d694c128fb9e1b98c1af1b8 as hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testConsecutiveExports/d2301b45cccde46626cc7815b283cf3a/cf/bb83d7e09d694c128fb9e1b98c1af1b8 2023-07-14 05:12:39,567 INFO [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testConsecutiveExports/d2301b45cccde46626cc7815b283cf3a/cf/bb83d7e09d694c128fb9e1b98c1af1b8, entries=5, sequenceid=6, filesize=5.2 K 2023-07-14 05:12:39,568 INFO [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for d2301b45cccde46626cc7815b283cf3a in 57ms, sequenceid=6, compaction requested=false 2023-07-14 05:12:39,569 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-14 05:12:39,569 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d2301b45cccde46626cc7815b283cf3a: 2023-07-14 05:12:39,569 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689311558327.d2301b45cccde46626cc7815b283cf3a.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-14 05:12:39,569 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 05:12:39,569 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testConsecutiveExports/d2301b45cccde46626cc7815b283cf3a/cf/bb83d7e09d694c128fb9e1b98c1af1b8] hfiles 2023-07-14 05:12:39,570 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testConsecutiveExports/d2301b45cccde46626cc7815b283cf3a/cf/bb83d7e09d694c128fb9e1b98c1af1b8 for snapshot=snaptb0-testConsecutiveExports 2023-07-14 05:12:39,577 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testConsecutiveExports/9798a4e82be50287a43cb1ad8a9c5b0a/.tmp/cf/62b91bc7a6004c918ed2922a4646fbbf as hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testConsecutiveExports/9798a4e82be50287a43cb1ad8a9c5b0a/cf/62b91bc7a6004c918ed2922a4646fbbf 2023-07-14 05:12:39,605 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689311558327.d2301b45cccde46626cc7815b283cf3a. completed. 2023-07-14 05:12:39,605 INFO [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testConsecutiveExports/9798a4e82be50287a43cb1ad8a9c5b0a/cf/62b91bc7a6004c918ed2922a4646fbbf, entries=45, sequenceid=6, filesize=7.9 K 2023-07-14 05:12:39,605 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689311558327.d2301b45cccde46626cc7815b283cf3a. 2023-07-14 05:12:39,605 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 05:12:39,605 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 05:12:39,605 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:39,605 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-14 05:12:39,605 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35535,1689311513825' in zk 2023-07-14 05:12:39,606 INFO [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 9798a4e82be50287a43cb1ad8a9c5b0a in 95ms, sequenceid=6, compaction requested=false 2023-07-14 05:12:39,607 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9798a4e82be50287a43cb1ad8a9c5b0a: 2023-07-14 05:12:39,608 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689311558327.9798a4e82be50287a43cb1ad8a9c5b0a.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-14 05:12:39,608 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 05:12:39,608 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testConsecutiveExports/9798a4e82be50287a43cb1ad8a9c5b0a/cf/62b91bc7a6004c918ed2922a4646fbbf] hfiles 2023-07-14 05:12:39,608 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testConsecutiveExports/9798a4e82be50287a43cb1ad8a9c5b0a/cf/62b91bc7a6004c918ed2922a4646fbbf for snapshot=snaptb0-testConsecutiveExports 2023-07-14 05:12:39,609 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:39,609 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-14 05:12:39,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:39,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:12:39,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:12:39,609 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 05:12:39,610 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-14 05:12:39,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:12:39,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:12:39,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 05:12:39,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:39,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:39,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:39,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:12:39,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 05:12:39,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:39,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:39,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,35535,1689311513825': 2023-07-14 05:12:39,616 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35535,1689311513825' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-14 05:12:39,620 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689311558327.9798a4e82be50287a43cb1ad8a9c5b0a. completed. 2023-07-14 05:12:39,620 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689311558327.9798a4e82be50287a43cb1ad8a9c5b0a. 2023-07-14 05:12:39,620 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 05:12:39,620 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 05:12:39,620 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:39,620 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-14 05:12:39,620 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43331,1689311513888' in zk 2023-07-14 05:12:39,624 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-14 05:12:39,624 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:39,624 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 05:12:39,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:39,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:12:39,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:12:39,624 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-14 05:12:39,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:12:39,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:12:39,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 05:12:39,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:39,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:39,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:39,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:12:39,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 05:12:39,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:39,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:39,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:39,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,43331,1689311513888': 2023-07-14 05:12:39,630 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43331,1689311513888' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-14 05:12:39,630 INFO [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-14 05:12:39,630 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 05:12:39,630 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 05:12:39,630 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-14 05:12:39,630 INFO [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 05:12:39,632 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 05:12:39,632 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 05:12:39,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 05:12:39,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 05:12:39,632 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 05:12:39,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 05:12:39,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 05:12:39,632 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:12:39,632 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:12:39,632 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 05:12:39,632 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:12:39,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 05:12:39,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 05:12:39,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:12:39,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:12:39,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 05:12:39,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:12:39,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:12:39,633 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:39,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:12:39,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:12:39,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 05:12:39,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:12:39,634 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:39,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:12:39,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 05:12:39,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:12:39,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 05:12:39,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 05:12:39,634 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:39,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:12:39,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 05:12:39,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:39,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:39,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:39,636 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:39,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:12:39,637 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:39,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 05:12:39,637 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:39,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:39,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:39,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:39,645 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:39,645 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:12:39,645 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 05:12:39,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:12:39,645 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:12:39,645 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:12:39,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:12:39,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:12:39,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:12:39,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:12:39,645 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:12:39,645 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:12:39,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:12:39,645 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:39,645 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:12:39,646 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:39,645 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-14 05:12:39,646 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-14 05:12:39,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:12:39,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:12:39,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:12:39,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:12:39,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:12:39,645 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 05:12:39,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:12:39,646 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 05:12:39,646 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:12:39,647 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 05:12:39,647 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:12:39,648 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:12:39,649 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 05:12:39,649 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 05:12:39,649 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 05:12:39,677 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-14 05:12:39,696 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-14 05:12:39,696 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 05:12:39,696 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 05:12:39,696 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689311559431Consolidate snapshot: snaptb0-testConsecutiveExports at 1689311559646 (+215 ms)Loading Region manifests for snaptb0-testConsecutiveExports at 1689311559646Writing data manifest for snaptb0-testConsecutiveExports at 1689311559652 (+6 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689311559670 (+18 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689311559696 (+26 ms) 2023-07-14 05:12:39,699 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-14 05:12:39,701 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 267 msec 2023-07-14 05:12:39,735 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 05:12:39,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-14 05:12:39,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 05:12:39,736 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/local-export-1689311559736 2023-07-14 05:12:39,737 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/local-export-1689311559736, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/local-export-1689311559736, srcFsUri=hdfs://localhost:36535, srcDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48 2023-07-14 05:12:39,760 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36535, inputRoot=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48 2023-07-14 05:12:39,760 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@7dfead41, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/local-export-1689311559736, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/local-export-1689311559736/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 05:12:39,760 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36535, inputRoot=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48, snapshotDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-14 05:12:39,768 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/local-export-1689311559736/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 05:12:39,780 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 05:12:39,780 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 05:12:39,781 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 05:12:39,781 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 05:12:39,781 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-14 05:12:39,782 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 05:12:39,782 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 05:12:39,849 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/hadoop-1377920911989642598.jar 2023-07-14 05:12:39,850 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 05:12:39,850 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 05:12:39,851 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 05:12:39,851 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 05:12:39,852 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 05:12:39,852 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 05:12:39,852 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 05:12:39,853 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 05:12:39,853 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 05:12:39,854 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 05:12:39,854 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 05:12:39,854 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 05:12:39,855 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 05:12:39,855 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 05:12:39,855 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 05:12:39,856 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 05:12:39,856 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 05:12:39,857 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 05:12:39,857 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 05:12:39,857 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 05:12:39,857 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 05:12:39,858 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 05:12:39,858 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 05:12:40,378 WARN [Listener at jenkins-hbase4.apache.org/38651] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 05:12:40,381 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-14 05:12:40,383 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-14 05:12:42,290 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 05:12:42,290 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 05:12:42,293 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689311521774_0002_000001 (auth:SIMPLE) 2023-07-14 05:12:42,828 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689311521774_0003_000001 (auth:SIMPLE) 2023-07-14 05:12:43,592 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 05:12:47,328 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689311521774_0003_000001 (auth:SIMPLE) 2023-07-14 05:12:49,562 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689311521774_0003_000001 (auth:SIMPLE) 2023-07-14 05:12:52,219 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689311521774_0003_000001 (auth:SIMPLE) 2023-07-14 05:12:53,563 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 05:12:53,563 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 05:12:53,567 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-14 05:12:53,567 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 05:12:53,568 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 05:12:53,568 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-839015254_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-14 05:12:53,568 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(367): hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-14 05:12:53,568 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(367): hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-14 05:12:53,569 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@4a3e35a5 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/local-export-1689311559736/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/local-export-1689311559736/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-14 05:12:53,569 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/local-export-1689311559736/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-14 05:12:53,569 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/local-export-1689311559736/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-14 05:12:53,570 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/local-export-1689311559736, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/local-export-1689311559736, srcFsUri=hdfs://localhost:36535, srcDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48 2023-07-14 05:12:53,591 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36535, inputRoot=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48 2023-07-14 05:12:53,591 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@51d4a123, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/local-export-1689311559736, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/local-export-1689311559736/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 05:12:53,591 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36535, inputRoot=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48, snapshotDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-14 05:12:53,602 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/local-export-1689311559736/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 05:12:53,614 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 05:12:53,614 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 05:12:53,615 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 05:12:53,615 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 05:12:53,615 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-14 05:12:53,616 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 05:12:53,616 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 05:12:53,684 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/hadoop-8904779478703297292.jar 2023-07-14 05:12:53,684 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 05:12:53,685 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 05:12:53,685 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 05:12:53,685 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 05:12:53,686 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 05:12:53,686 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 05:12:53,686 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 05:12:53,687 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 05:12:53,687 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 05:12:53,687 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 05:12:53,688 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 05:12:53,688 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 05:12:53,689 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 05:12:53,689 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 05:12:53,689 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 05:12:53,690 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 05:12:53,690 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 05:12:53,690 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 05:12:53,691 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 05:12:53,691 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 05:12:53,691 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 05:12:53,692 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 05:12:53,692 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 05:12:54,061 WARN [Listener at jenkins-hbase4.apache.org/38651] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 05:12:54,065 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-14 05:12:54,067 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-14 05:12:58,404 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 05:12:58,404 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 05:12:58,407 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689311521774_0003_000001 (auth:SIMPLE) 2023-07-14 05:12:59,305 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689311521774_0004_000001 (auth:SIMPLE) 2023-07-14 05:13:03,594 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689311521774_0004_000001 (auth:SIMPLE) 2023-07-14 05:13:05,830 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689311521774_0004_000001 (auth:SIMPLE) 2023-07-14 05:13:08,472 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689311521774_0004_000001 (auth:SIMPLE) 2023-07-14 05:13:10,316 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 05:13:10,317 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 05:13:10,323 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-14 05:13:10,324 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 05:13:10,324 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 05:13:10,324 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-839015254_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-14 05:13:10,329 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(367): hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-14 05:13:10,329 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(367): hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-14 05:13:10,329 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@4a3e35a5 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/local-export-1689311559736/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/local-export-1689311559736/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-14 05:13:10,330 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/local-export-1689311559736/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-14 05:13:10,330 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/local-export-1689311559736/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-14 05:13:10,348 INFO [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-14 05:13:10,348 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-14 05:13:10,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-14 05:13:10,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-14 05:13:10,383 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689311590382"}]},"ts":"1689311590382"} 2023-07-14 05:13:10,386 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-14 05:13:10,388 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-14 05:13:10,390 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d2301b45cccde46626cc7815b283cf3a, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9798a4e82be50287a43cb1ad8a9c5b0a, UNASSIGN}] 2023-07-14 05:13:10,397 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9798a4e82be50287a43cb1ad8a9c5b0a, UNASSIGN 2023-07-14 05:13:10,398 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d2301b45cccde46626cc7815b283cf3a, UNASSIGN 2023-07-14 05:13:10,399 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=9798a4e82be50287a43cb1ad8a9c5b0a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:10,399 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=d2301b45cccde46626cc7815b283cf3a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:10,399 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689311558327.9798a4e82be50287a43cb1ad8a9c5b0a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689311590399"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689311590399"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689311590399"}]},"ts":"1689311590399"} 2023-07-14 05:13:10,399 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689311558327.d2301b45cccde46626cc7815b283cf3a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689311590399"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689311590399"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689311590399"}]},"ts":"1689311590399"} 2023-07-14 05:13:10,402 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure 9798a4e82be50287a43cb1ad8a9c5b0a, server=jenkins-hbase4.apache.org,43331,1689311513888}] 2023-07-14 05:13:10,403 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure d2301b45cccde46626cc7815b283cf3a, server=jenkins-hbase4.apache.org,35535,1689311513825}] 2023-07-14 05:13:10,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-14 05:13:10,555 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9798a4e82be50287a43cb1ad8a9c5b0a 2023-07-14 05:13:10,556 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d2301b45cccde46626cc7815b283cf3a 2023-07-14 05:13:10,556 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9798a4e82be50287a43cb1ad8a9c5b0a, disabling compactions & flushes 2023-07-14 05:13:10,556 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689311558327.9798a4e82be50287a43cb1ad8a9c5b0a. 2023-07-14 05:13:10,556 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d2301b45cccde46626cc7815b283cf3a, disabling compactions & flushes 2023-07-14 05:13:10,556 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689311558327.9798a4e82be50287a43cb1ad8a9c5b0a. 2023-07-14 05:13:10,556 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689311558327.d2301b45cccde46626cc7815b283cf3a. 2023-07-14 05:13:10,556 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689311558327.9798a4e82be50287a43cb1ad8a9c5b0a. after waiting 0 ms 2023-07-14 05:13:10,556 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689311558327.9798a4e82be50287a43cb1ad8a9c5b0a. 2023-07-14 05:13:10,556 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689311558327.d2301b45cccde46626cc7815b283cf3a. 2023-07-14 05:13:10,556 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689311558327.d2301b45cccde46626cc7815b283cf3a. after waiting 0 ms 2023-07-14 05:13:10,556 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689311558327.d2301b45cccde46626cc7815b283cf3a. 2023-07-14 05:13:10,579 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testConsecutiveExports/d2301b45cccde46626cc7815b283cf3a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 05:13:10,580 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 05:13:10,581 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testConsecutiveExports/9798a4e82be50287a43cb1ad8a9c5b0a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 05:13:10,582 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689311558327.d2301b45cccde46626cc7815b283cf3a. 2023-07-14 05:13:10,582 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d2301b45cccde46626cc7815b283cf3a: 2023-07-14 05:13:10,584 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 05:13:10,585 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689311558327.9798a4e82be50287a43cb1ad8a9c5b0a. 2023-07-14 05:13:10,585 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9798a4e82be50287a43cb1ad8a9c5b0a: 2023-07-14 05:13:10,586 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d2301b45cccde46626cc7815b283cf3a 2023-07-14 05:13:10,586 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=d2301b45cccde46626cc7815b283cf3a, regionState=CLOSED 2023-07-14 05:13:10,587 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689311558327.d2301b45cccde46626cc7815b283cf3a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689311590586"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689311590586"}]},"ts":"1689311590586"} 2023-07-14 05:13:10,590 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9798a4e82be50287a43cb1ad8a9c5b0a 2023-07-14 05:13:10,590 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=9798a4e82be50287a43cb1ad8a9c5b0a, regionState=CLOSED 2023-07-14 05:13:10,591 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689311558327.9798a4e82be50287a43cb1ad8a9c5b0a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689311590590"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689311590590"}]},"ts":"1689311590590"} 2023-07-14 05:13:10,596 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-14 05:13:10,596 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure d2301b45cccde46626cc7815b283cf3a, server=jenkins-hbase4.apache.org,35535,1689311513825 in 190 msec 2023-07-14 05:13:10,597 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-14 05:13:10,597 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure 9798a4e82be50287a43cb1ad8a9c5b0a, server=jenkins-hbase4.apache.org,43331,1689311513888 in 192 msec 2023-07-14 05:13:10,598 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d2301b45cccde46626cc7815b283cf3a, UNASSIGN in 206 msec 2023-07-14 05:13:10,600 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-14 05:13:10,600 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9798a4e82be50287a43cb1ad8a9c5b0a, UNASSIGN in 207 msec 2023-07-14 05:13:10,601 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689311590601"}]},"ts":"1689311590601"} 2023-07-14 05:13:10,609 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-14 05:13:10,617 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-14 05:13:10,620 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 269 msec 2023-07-14 05:13:10,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-14 05:13:10,667 INFO [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-14 05:13:10,668 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-14 05:13:10,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-14 05:13:10,672 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-14 05:13:10,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-14 05:13:10,674 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-14 05:13:10,678 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35487] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-14 05:13:10,681 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 05:13:10,681 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 05:13:10,681 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 05:13:10,681 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 05:13:10,682 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-14 05:13:10,682 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-14 05:13:10,682 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-14 05:13:10,682 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-14 05:13:10,683 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 05:13:10,683 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 05:13:10,683 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 05:13:10,683 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 05:13:10,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-14 05:13:10,685 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 05:13:10,685 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 05:13:10,685 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testConsecutiveExports/d2301b45cccde46626cc7815b283cf3a 2023-07-14 05:13:10,688 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testConsecutiveExports/9798a4e82be50287a43cb1ad8a9c5b0a 2023-07-14 05:13:10,688 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testConsecutiveExports/d2301b45cccde46626cc7815b283cf3a/cf, FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testConsecutiveExports/d2301b45cccde46626cc7815b283cf3a/recovered.edits] 2023-07-14 05:13:10,688 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 05:13:10,689 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 05:13:10,694 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testConsecutiveExports/9798a4e82be50287a43cb1ad8a9c5b0a/cf, FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testConsecutiveExports/9798a4e82be50287a43cb1ad8a9c5b0a/recovered.edits] 2023-07-14 05:13:10,702 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testConsecutiveExports/9798a4e82be50287a43cb1ad8a9c5b0a/cf/62b91bc7a6004c918ed2922a4646fbbf to hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/archive/data/default/testtb-testConsecutiveExports/9798a4e82be50287a43cb1ad8a9c5b0a/cf/62b91bc7a6004c918ed2922a4646fbbf 2023-07-14 05:13:10,702 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testConsecutiveExports/d2301b45cccde46626cc7815b283cf3a/cf/bb83d7e09d694c128fb9e1b98c1af1b8 to hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/archive/data/default/testtb-testConsecutiveExports/d2301b45cccde46626cc7815b283cf3a/cf/bb83d7e09d694c128fb9e1b98c1af1b8 2023-07-14 05:13:10,709 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testConsecutiveExports/9798a4e82be50287a43cb1ad8a9c5b0a/recovered.edits/9.seqid to hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/archive/data/default/testtb-testConsecutiveExports/9798a4e82be50287a43cb1ad8a9c5b0a/recovered.edits/9.seqid 2023-07-14 05:13:10,709 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testConsecutiveExports/d2301b45cccde46626cc7815b283cf3a/recovered.edits/9.seqid to hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/archive/data/default/testtb-testConsecutiveExports/d2301b45cccde46626cc7815b283cf3a/recovered.edits/9.seqid 2023-07-14 05:13:10,710 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testConsecutiveExports/9798a4e82be50287a43cb1ad8a9c5b0a 2023-07-14 05:13:10,710 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testConsecutiveExports/d2301b45cccde46626cc7815b283cf3a 2023-07-14 05:13:10,710 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-14 05:13:10,713 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-14 05:13:10,721 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-14 05:13:10,725 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-14 05:13:10,727 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-14 05:13:10,727 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-14 05:13:10,727 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689311558327.d2301b45cccde46626cc7815b283cf3a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689311590727"}]},"ts":"9223372036854775807"} 2023-07-14 05:13:10,727 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689311558327.9798a4e82be50287a43cb1ad8a9c5b0a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689311590727"}]},"ts":"9223372036854775807"} 2023-07-14 05:13:10,733 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-14 05:13:10,733 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d2301b45cccde46626cc7815b283cf3a, NAME => 'testtb-testConsecutiveExports,,1689311558327.d2301b45cccde46626cc7815b283cf3a.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 9798a4e82be50287a43cb1ad8a9c5b0a, NAME => 'testtb-testConsecutiveExports,1,1689311558327.9798a4e82be50287a43cb1ad8a9c5b0a.', STARTKEY => '1', ENDKEY => ''}] 2023-07-14 05:13:10,733 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-14 05:13:10,733 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689311590733"}]},"ts":"9223372036854775807"} 2023-07-14 05:13:10,747 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-14 05:13:10,760 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-14 05:13:10,762 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 92 msec 2023-07-14 05:13:10,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-14 05:13:10,786 INFO [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-14 05:13:10,796 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-14 05:13:10,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-14 05:13:10,800 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-14 05:13:10,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-14 05:13:10,829 INFO [Listener at jenkins-hbase4.apache.org/38651] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=747 (was 767), OpenFileDescriptor=900 (was 917), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=382 (was 295) - SystemLoadAverage LEAK? -, ProcessCount=184 (was 182) - ProcessCount LEAK? -, AvailableMemoryMB=4094 (was 3736) - AvailableMemoryMB LEAK? - 2023-07-14 05:13:10,829 WARN [Listener at jenkins-hbase4.apache.org/38651] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-07-14 05:13:10,851 INFO [Listener at jenkins-hbase4.apache.org/38651] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=747, OpenFileDescriptor=900, MaxFileDescriptor=60000, SystemLoadAverage=382, ProcessCount=184, AvailableMemoryMB=4092 2023-07-14 05:13:10,851 WARN [Listener at jenkins-hbase4.apache.org/38651] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-07-14 05:13:10,853 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-14 05:13:10,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:10,857 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 05:13:10,857 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-14 05:13:10,858 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 05:13:10,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-14 05:13:10,860 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f064f7780ebd82e31929c68278f31645 2023-07-14 05:13:10,860 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/19ccb6e05b16484cd988b85623700843 2023-07-14 05:13:10,861 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/19ccb6e05b16484cd988b85623700843 empty. 2023-07-14 05:13:10,861 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f064f7780ebd82e31929c68278f31645 empty. 2023-07-14 05:13:10,861 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/19ccb6e05b16484cd988b85623700843 2023-07-14 05:13:10,861 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f064f7780ebd82e31929c68278f31645 2023-07-14 05:13:10,862 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-14 05:13:10,877 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-14 05:13:10,879 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 19ccb6e05b16484cd988b85623700843, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689311590853.19ccb6e05b16484cd988b85623700843.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp 2023-07-14 05:13:10,879 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => f064f7780ebd82e31929c68278f31645, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689311590853.f064f7780ebd82e31929c68278f31645.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp 2023-07-14 05:13:10,925 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689311590853.19ccb6e05b16484cd988b85623700843.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 05:13:10,925 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 19ccb6e05b16484cd988b85623700843, disabling compactions & flushes 2023-07-14 05:13:10,926 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689311590853.19ccb6e05b16484cd988b85623700843. 2023-07-14 05:13:10,926 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689311590853.19ccb6e05b16484cd988b85623700843. 2023-07-14 05:13:10,926 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689311590853.19ccb6e05b16484cd988b85623700843. after waiting 0 ms 2023-07-14 05:13:10,926 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689311590853.19ccb6e05b16484cd988b85623700843. 2023-07-14 05:13:10,926 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689311590853.19ccb6e05b16484cd988b85623700843. 2023-07-14 05:13:10,926 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 19ccb6e05b16484cd988b85623700843: 2023-07-14 05:13:10,937 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689311590853.f064f7780ebd82e31929c68278f31645.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 05:13:10,937 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing f064f7780ebd82e31929c68278f31645, disabling compactions & flushes 2023-07-14 05:13:10,937 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689311590853.f064f7780ebd82e31929c68278f31645. 2023-07-14 05:13:10,937 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689311590853.f064f7780ebd82e31929c68278f31645. 2023-07-14 05:13:10,937 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689311590853.f064f7780ebd82e31929c68278f31645. after waiting 0 ms 2023-07-14 05:13:10,937 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689311590853.f064f7780ebd82e31929c68278f31645. 2023-07-14 05:13:10,937 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689311590853.f064f7780ebd82e31929c68278f31645. 2023-07-14 05:13:10,938 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for f064f7780ebd82e31929c68278f31645: 2023-07-14 05:13:10,943 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 05:13:10,945 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689311590853.19ccb6e05b16484cd988b85623700843.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689311590945"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689311590945"}]},"ts":"1689311590945"} 2023-07-14 05:13:10,945 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689311590853.f064f7780ebd82e31929c68278f31645.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689311590945"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689311590945"}]},"ts":"1689311590945"} 2023-07-14 05:13:10,952 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 05:13:10,953 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 05:13:10,953 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689311590953"}]},"ts":"1689311590953"} 2023-07-14 05:13:10,957 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-14 05:13:10,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-14 05:13:10,960 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-14 05:13:10,961 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 05:13:10,961 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 05:13:10,961 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 05:13:10,961 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 05:13:10,962 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f064f7780ebd82e31929c68278f31645, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=19ccb6e05b16484cd988b85623700843, ASSIGN}] 2023-07-14 05:13:10,965 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=19ccb6e05b16484cd988b85623700843, ASSIGN 2023-07-14 05:13:10,965 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f064f7780ebd82e31929c68278f31645, ASSIGN 2023-07-14 05:13:10,966 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f064f7780ebd82e31929c68278f31645, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35535,1689311513825; forceNewPlan=false, retain=false 2023-07-14 05:13:10,966 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=19ccb6e05b16484cd988b85623700843, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35487,1689311513755; forceNewPlan=false, retain=false 2023-07-14 05:13:11,117 INFO [jenkins-hbase4:35845] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 05:13:11,120 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=19ccb6e05b16484cd988b85623700843, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:11,120 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=f064f7780ebd82e31929c68278f31645, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:11,121 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689311590853.19ccb6e05b16484cd988b85623700843.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689311591120"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689311591120"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689311591120"}]},"ts":"1689311591120"} 2023-07-14 05:13:11,121 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689311590853.f064f7780ebd82e31929c68278f31645.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689311591120"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689311591120"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689311591120"}]},"ts":"1689311591120"} 2023-07-14 05:13:11,123 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 19ccb6e05b16484cd988b85623700843, server=jenkins-hbase4.apache.org,35487,1689311513755}] 2023-07-14 05:13:11,124 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure f064f7780ebd82e31929c68278f31645, server=jenkins-hbase4.apache.org,35535,1689311513825}] 2023-07-14 05:13:11,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-14 05:13:11,284 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689311590853.f064f7780ebd82e31929c68278f31645. 2023-07-14 05:13:11,284 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f064f7780ebd82e31929c68278f31645, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689311590853.f064f7780ebd82e31929c68278f31645.', STARTKEY => '', ENDKEY => '1'} 2023-07-14 05:13:11,284 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689311590853.f064f7780ebd82e31929c68278f31645. service=AccessControlService 2023-07-14 05:13:11,285 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 05:13:11,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion f064f7780ebd82e31929c68278f31645 2023-07-14 05:13:11,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689311590853.f064f7780ebd82e31929c68278f31645.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 05:13:11,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f064f7780ebd82e31929c68278f31645 2023-07-14 05:13:11,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f064f7780ebd82e31929c68278f31645 2023-07-14 05:13:11,286 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689311590853.19ccb6e05b16484cd988b85623700843. 2023-07-14 05:13:11,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 19ccb6e05b16484cd988b85623700843, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689311590853.19ccb6e05b16484cd988b85623700843.', STARTKEY => '1', ENDKEY => ''} 2023-07-14 05:13:11,287 INFO [StoreOpener-f064f7780ebd82e31929c68278f31645-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f064f7780ebd82e31929c68278f31645 2023-07-14 05:13:11,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689311590853.19ccb6e05b16484cd988b85623700843. service=AccessControlService 2023-07-14 05:13:11,287 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 05:13:11,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 19ccb6e05b16484cd988b85623700843 2023-07-14 05:13:11,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689311590853.19ccb6e05b16484cd988b85623700843.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 05:13:11,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 19ccb6e05b16484cd988b85623700843 2023-07-14 05:13:11,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 19ccb6e05b16484cd988b85623700843 2023-07-14 05:13:11,289 DEBUG [StoreOpener-f064f7780ebd82e31929c68278f31645-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion/f064f7780ebd82e31929c68278f31645/cf 2023-07-14 05:13:11,289 DEBUG [StoreOpener-f064f7780ebd82e31929c68278f31645-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion/f064f7780ebd82e31929c68278f31645/cf 2023-07-14 05:13:11,289 INFO [StoreOpener-19ccb6e05b16484cd988b85623700843-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 19ccb6e05b16484cd988b85623700843 2023-07-14 05:13:11,290 INFO [StoreOpener-f064f7780ebd82e31929c68278f31645-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f064f7780ebd82e31929c68278f31645 columnFamilyName cf 2023-07-14 05:13:11,295 INFO [StoreOpener-f064f7780ebd82e31929c68278f31645-1] regionserver.HStore(310): Store=f064f7780ebd82e31929c68278f31645/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 05:13:11,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion/f064f7780ebd82e31929c68278f31645 2023-07-14 05:13:11,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion/f064f7780ebd82e31929c68278f31645 2023-07-14 05:13:11,300 DEBUG [StoreOpener-19ccb6e05b16484cd988b85623700843-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion/19ccb6e05b16484cd988b85623700843/cf 2023-07-14 05:13:11,300 DEBUG [StoreOpener-19ccb6e05b16484cd988b85623700843-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion/19ccb6e05b16484cd988b85623700843/cf 2023-07-14 05:13:11,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f064f7780ebd82e31929c68278f31645 2023-07-14 05:13:11,301 INFO [StoreOpener-19ccb6e05b16484cd988b85623700843-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 19ccb6e05b16484cd988b85623700843 columnFamilyName cf 2023-07-14 05:13:11,301 INFO [StoreOpener-19ccb6e05b16484cd988b85623700843-1] regionserver.HStore(310): Store=19ccb6e05b16484cd988b85623700843/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 05:13:11,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion/19ccb6e05b16484cd988b85623700843 2023-07-14 05:13:11,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion/19ccb6e05b16484cd988b85623700843 2023-07-14 05:13:11,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion/f064f7780ebd82e31929c68278f31645/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 05:13:11,304 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f064f7780ebd82e31929c68278f31645; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68541043, jitterRate=0.021341130137443542}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 05:13:11,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f064f7780ebd82e31929c68278f31645: 2023-07-14 05:13:11,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 19ccb6e05b16484cd988b85623700843 2023-07-14 05:13:11,308 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689311590853.f064f7780ebd82e31929c68278f31645., pid=61, masterSystemTime=1689311591276 2023-07-14 05:13:11,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion/19ccb6e05b16484cd988b85623700843/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 05:13:11,311 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 19ccb6e05b16484cd988b85623700843; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67684333, jitterRate=0.008575156331062317}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 05:13:11,311 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 19ccb6e05b16484cd988b85623700843: 2023-07-14 05:13:11,312 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689311590853.19ccb6e05b16484cd988b85623700843., pid=60, masterSystemTime=1689311591275 2023-07-14 05:13:11,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689311590853.f064f7780ebd82e31929c68278f31645. 2023-07-14 05:13:11,321 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689311590853.f064f7780ebd82e31929c68278f31645. 2023-07-14 05:13:11,321 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=f064f7780ebd82e31929c68278f31645, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:11,321 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689311590853.f064f7780ebd82e31929c68278f31645.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689311591321"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689311591321"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689311591321"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689311591321"}]},"ts":"1689311591321"} 2023-07-14 05:13:11,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689311590853.19ccb6e05b16484cd988b85623700843. 2023-07-14 05:13:11,322 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689311590853.19ccb6e05b16484cd988b85623700843. 2023-07-14 05:13:11,323 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=19ccb6e05b16484cd988b85623700843, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:11,323 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689311590853.19ccb6e05b16484cd988b85623700843.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689311591323"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689311591323"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689311591323"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689311591323"}]},"ts":"1689311591323"} 2023-07-14 05:13:11,329 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-14 05:13:11,329 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-14 05:13:11,329 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure f064f7780ebd82e31929c68278f31645, server=jenkins-hbase4.apache.org,35535,1689311513825 in 202 msec 2023-07-14 05:13:11,329 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 19ccb6e05b16484cd988b85623700843, server=jenkins-hbase4.apache.org,35487,1689311513755 in 203 msec 2023-07-14 05:13:11,331 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f064f7780ebd82e31929c68278f31645, ASSIGN in 367 msec 2023-07-14 05:13:11,332 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-14 05:13:11,332 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=19ccb6e05b16484cd988b85623700843, ASSIGN in 367 msec 2023-07-14 05:13:11,333 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 05:13:11,333 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689311591333"}]},"ts":"1689311591333"} 2023-07-14 05:13:11,336 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-14 05:13:11,339 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 05:13:11,339 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-14 05:13:11,342 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35487] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-14 05:13:11,343 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 05:13:11,344 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 05:13:11,344 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 05:13:11,344 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 05:13:11,346 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 05:13:11,346 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 05:13:11,346 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 05:13:11,346 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 05:13:11,356 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 494 msec 2023-07-14 05:13:11,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-14 05:13:11,462 INFO [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-14 05:13:11,463 DEBUG [Listener at jenkins-hbase4.apache.org/38651] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithMergeRegion get assigned. Timeout = 60000ms 2023-07-14 05:13:11,463 INFO [Listener at jenkins-hbase4.apache.org/38651] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 05:13:11,467 INFO [Listener at jenkins-hbase4.apache.org/38651] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned to meta. Checking AM states. 2023-07-14 05:13:11,467 INFO [Listener at jenkins-hbase4.apache.org/38651] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 05:13:11,467 INFO [Listener at jenkins-hbase4.apache.org/38651] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned. 2023-07-14 05:13:11,474 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-14 05:13:11,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689311591474 (current time:1689311591474). 2023-07-14 05:13:11,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 05:13:11,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] zookeeper.ReadOnlyZKClient(139): Connect 0x33e2d23f to 127.0.0.1:55310 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 05:13:11,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d33efae, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 05:13:11,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 05:13:11,492 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44550, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 05:13:11,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x33e2d23f to 127.0.0.1:55310 2023-07-14 05:13:11,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 05:13:11,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] zookeeper.ReadOnlyZKClient(139): Connect 0x45de5d56 to 127.0.0.1:55310 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 05:13:11,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@60081cf8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 05:13:11,506 DEBUG [hconnection-0x3214c1c8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 05:13:11,510 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44560, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 05:13:11,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 05:13:11,520 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33960, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 05:13:11,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x45de5d56 to 127.0.0.1:55310 2023-07-14 05:13:11,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 05:13:11,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-14 05:13:11,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 05:13:11,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-14 05:13:11,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-14 05:13:11,526 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-14 05:13:11,527 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689312191527 2023-07-14 05:13:11,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-14 05:13:11,527 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,529 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 05:13:11,529 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-14 05:13:11,529 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 05:13:11,531 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-07-14 05:13:11,532 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-14 05:13:11,533 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-14 05:13:11,533 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689312191533 2023-07-14 05:13:11,569 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,569 INFO [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-14 05:13:11,569 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 05:13:11,571 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-14 05:13:11,572 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-14 05:13:11,572 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,572 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,574 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:13:11,574 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:13:11,574 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:13:11,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:13:11,574 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:11,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:13:11,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:13:11,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:13:11,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:13:11,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:13:11,574 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:11,574 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:11,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,575 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:11,575 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 05:13:11,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,576 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,576 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,576 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-14 05:13:11,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,578 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-14 05:13:11,578 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,578 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-14 05:13:11,578 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 05:13:11,580 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-14 05:13:11,580 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-14 05:13:11,580 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35535,1689311513825' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-14 05:13:11,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-14 05:13:11,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,582 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-14 05:13:11,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-14 05:13:11,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,583 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,583 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-14 05:13:11,583 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 05:13:11,584 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-14 05:13:11,584 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-14 05:13:11,584 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43331,1689311513888' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-14 05:13:11,584 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-14 05:13:11,587 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,587 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,587 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 05:13:11,590 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,590 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,591 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-14 05:13:11,591 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 05:13:11,590 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:11,592 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-14 05:13:11,592 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-14 05:13:11,592 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35487,1689311513755' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-14 05:13:11,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:11,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:13:11,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:13:11,594 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,594 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,594 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 05:13:11,595 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,595 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:11,595 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 05:13:11,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:13:11,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:13:11,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:11,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:11,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:11,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:13:11,598 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35535,1689311513825' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-14 05:13:11,598 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6ca688ce[Count = 1] remaining members to acquire global barrier 2023-07-14 05:13:11,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:11,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:13:11,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:13:11,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:13:11,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:13:11,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:11,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:11,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:11,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:13:11,603 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35487,1689311513755' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-14 05:13:11,603 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6ca688ce[Count = 0] remaining members to acquire global barrier 2023-07-14 05:13:11,603 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-14 05:13:11,603 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,605 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,605 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,605 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,606 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-14 05:13:11,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,606 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-14 05:13:11,606 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-14 05:13:11,606 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-14 05:13:11,606 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43331,1689311513888' in zk 2023-07-14 05:13:11,612 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:11,612 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:11,613 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 05:13:11,614 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-14 05:13:11,614 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 05:13:11,614 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-14 05:13:11,616 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 05:13:11,635 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 05:13:11,635 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689311590853.19ccb6e05b16484cd988b85623700843. 2023-07-14 05:13:11,634 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 05:13:11,635 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689311590853.19ccb6e05b16484cd988b85623700843. started... 2023-07-14 05:13:11,630 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 05:13:11,627 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689311590853.f064f7780ebd82e31929c68278f31645. 2023-07-14 05:13:11,635 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 05:13:11,636 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689311590853.f064f7780ebd82e31929c68278f31645. started... 2023-07-14 05:13:11,637 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 19ccb6e05b16484cd988b85623700843: 2023-07-14 05:13:11,639 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f064f7780ebd82e31929c68278f31645: 2023-07-14 05:13:11,639 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689311590853.19ccb6e05b16484cd988b85623700843.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,639 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 05:13:11,639 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689311590853.f064f7780ebd82e31929c68278f31645.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 05:13:11,639 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 05:13:11,639 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 05:13:11,639 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 05:13:11,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-14 05:13:11,640 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 05:13:11,655 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689311590853.f064f7780ebd82e31929c68278f31645. completed. 2023-07-14 05:13:11,655 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689311590853.f064f7780ebd82e31929c68278f31645. 2023-07-14 05:13:11,655 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 05:13:11,655 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 05:13:11,655 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:11,655 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-14 05:13:11,655 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35535,1689311513825' in zk 2023-07-14 05:13:11,657 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:11,657 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-14 05:13:11,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:11,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:13:11,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:13:11,657 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 05:13:11,657 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-14 05:13:11,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:13:11,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:13:11,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:11,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:11,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:11,666 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689311590853.19ccb6e05b16484cd988b85623700843. completed. 2023-07-14 05:13:11,666 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689311590853.19ccb6e05b16484cd988b85623700843. 2023-07-14 05:13:11,666 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 05:13:11,666 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 05:13:11,666 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:11,666 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-14 05:13:11,666 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35487,1689311513755' in zk 2023-07-14 05:13:11,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:13:11,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:11,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:11,668 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-14 05:13:11,669 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 05:13:11,669 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-14 05:13:11,669 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:11,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,35535,1689311513825': 2023-07-14 05:13:11,669 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35535,1689311513825' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-14 05:13:11,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:11,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:13:11,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:13:11,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:13:11,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:13:11,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:11,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:11,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:11,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:13:11,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:11,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:11,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:11,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,35487,1689311513755': 2023-07-14 05:13:11,677 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35487,1689311513755' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-14 05:13:11,677 INFO [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-14 05:13:11,677 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 05:13:11,677 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 05:13:11,677 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,677 INFO [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 05:13:11,679 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,679 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,679 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:13:11,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:13:11,679 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:13:11,679 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:13:11,679 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,680 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:13:11,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:13:11,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:13:11,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:13:11,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:13:11,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:13:11,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:13:11,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:13:11,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,681 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:11,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:13:11,682 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:11,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,682 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:11,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:11,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:11,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:11,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:13:11,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,687 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:11,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:11,687 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:11,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:11,687 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:11,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:11,691 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:13:11,691 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:13:11,691 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:11,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:13:11,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:13:11,691 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:13:11,692 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 05:13:11,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:13:11,691 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:13:11,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:13:11,692 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:13:11,692 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:13:11,693 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:13:11,691 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:13:11,691 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,694 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:11,694 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:11,694 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,694 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:11,694 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,694 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:11,694 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:11,694 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,694 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:13:11,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:13:11,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:13:11,694 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:13:11,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:13:11,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:13:11,733 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,795 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-14 05:13:11,795 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,796 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,796 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689311591527Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689311591693 (+166 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689311591694 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689311591707 (+13 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689311591723 (+16 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689311591795 (+72 ms) 2023-07-14 05:13:11,799 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-14 05:13:11,802 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 271 msec 2023-07-14 05:13:11,840 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 05:13:11,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 05:13:11,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 05:13:11,849 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35535] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689311590853.f064f7780ebd82e31929c68278f31645. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 05:13:11,851 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35487] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689311590853.19ccb6e05b16484cd988b85623700843. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 05:13:11,855 DEBUG [Listener at jenkins-hbase4.apache.org/38651] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,855 DEBUG [Listener at jenkins-hbase4.apache.org/38651] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689311590853.f064f7780ebd82e31929c68278f31645. 2023-07-14 05:13:11,855 INFO [Listener at jenkins-hbase4.apache.org/38651] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 05:13:11,869 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-14 05:13:11,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689311591869 (current time:1689311591869). 2023-07-14 05:13:11,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 05:13:11,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] zookeeper.ReadOnlyZKClient(139): Connect 0x6308290b to 127.0.0.1:55310 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 05:13:11,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@51f6418f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 05:13:11,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 05:13:11,883 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44568, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 05:13:11,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6308290b to 127.0.0.1:55310 2023-07-14 05:13:11,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 05:13:11,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] zookeeper.ReadOnlyZKClient(139): Connect 0x082e927c to 127.0.0.1:55310 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 05:13:11,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2a4cb203, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 05:13:11,919 DEBUG [hconnection-0x49d564fc-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 05:13:11,925 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44574, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 05:13:11,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 05:13:11,937 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33974, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 05:13:11,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x082e927c to 127.0.0.1:55310 2023-07-14 05:13:11,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 05:13:11,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-14 05:13:11,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 05:13:11,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-14 05:13:11,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-14 05:13:11,945 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-14 05:13:11,946 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689312191946 2023-07-14 05:13:11,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-14 05:13:11,946 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,946 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 05:13:11,947 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 05:13:11,950 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-14 05:13:11,951 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-14 05:13:11,952 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 8 msec 2023-07-14 05:13:11,953 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-14 05:13:11,953 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689312191953 2023-07-14 05:13:11,998 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:11,999 INFO [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-14 05:13:11,999 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 05:13:12,001 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-14 05:13:12,001 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-14 05:13:12,001 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,001 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,003 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:13:12,003 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:13:12,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:13:12,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:13:12,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:13:12,003 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:12,003 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:13:12,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:13:12,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:13:12,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:13:12,003 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:12,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,004 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:12,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,004 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,004 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:12,004 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 05:13:12,004 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,004 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-14 05:13:12,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,005 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-14 05:13:12,005 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,005 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-14 05:13:12,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-14 05:13:12,005 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 05:13:12,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-14 05:13:12,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,007 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-14 05:13:12,007 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-14 05:13:12,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,008 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-14 05:13:12,007 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-14 05:13:12,007 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35535,1689311513825' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-14 05:13:12,010 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:12,010 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:12,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:13:12,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:13:12,011 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,011 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 05:13:12,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:13:12,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:13:12,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:12,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:13:12,013 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35535,1689311513825' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-14 05:13:12,013 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@25e4b17[Count = 1] remaining members to acquire global barrier 2023-07-14 05:13:12,014 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,015 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-14 05:13:12,015 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 05:13:12,015 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,015 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-14 05:13:12,015 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 05:13:12,017 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-14 05:13:12,017 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-14 05:13:12,017 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-14 05:13:12,017 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35487,1689311513755' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-14 05:13:12,017 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-14 05:13:12,017 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43331,1689311513888' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-14 05:13:12,019 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:12,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:12,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:13:12,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:13:12,020 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,020 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,025 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,026 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,026 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 05:13:12,026 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 05:13:12,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:13:12,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:13:12,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:12,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:12,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:12,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:13:12,028 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35487,1689311513755' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-14 05:13:12,028 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@25e4b17[Count = 0] remaining members to acquire global barrier 2023-07-14 05:13:12,028 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-14 05:13:12,028 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,030 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,030 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,030 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,031 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-14 05:13:12,031 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-14 05:13:12,031 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-14 05:13:12,031 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43331,1689311513888' in zk 2023-07-14 05:13:12,031 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-14 05:13:12,032 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:12,034 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:12,034 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 05:13:12,043 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 05:13:12,043 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 05:13:12,045 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-14 05:13:12,045 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 05:13:12,045 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-14 05:13:12,047 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 05:13:12,047 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689311590853.f064f7780ebd82e31929c68278f31645. 2023-07-14 05:13:12,047 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689311590853.f064f7780ebd82e31929c68278f31645. started... 2023-07-14 05:13:12,047 INFO [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f064f7780ebd82e31929c68278f31645 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-14 05:13:12,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 05:13:12,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-14 05:13:12,054 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 05:13:12,058 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 05:13:12,059 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 05:13:12,061 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689311590853.19ccb6e05b16484cd988b85623700843. 2023-07-14 05:13:12,061 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689311590853.19ccb6e05b16484cd988b85623700843. started... 2023-07-14 05:13:12,061 INFO [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 19ccb6e05b16484cd988b85623700843 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-14 05:13:12,154 INFO [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.93 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion/19ccb6e05b16484cd988b85623700843/.tmp/cf/3c95ec501d8a4d6e894890bca216785e 2023-07-14 05:13:12,155 INFO [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=333 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion/f064f7780ebd82e31929c68278f31645/.tmp/cf/3fbc862eb9c34727bc27d1e205dfddcc 2023-07-14 05:13:12,164 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion/f064f7780ebd82e31929c68278f31645/.tmp/cf/3fbc862eb9c34727bc27d1e205dfddcc as hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion/f064f7780ebd82e31929c68278f31645/cf/3fbc862eb9c34727bc27d1e205dfddcc 2023-07-14 05:13:12,170 INFO [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion/f064f7780ebd82e31929c68278f31645/cf/3fbc862eb9c34727bc27d1e205dfddcc, entries=5, sequenceid=6, filesize=5.2 K 2023-07-14 05:13:12,171 INFO [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for f064f7780ebd82e31929c68278f31645 in 124ms, sequenceid=6, compaction requested=false 2023-07-14 05:13:12,171 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-14 05:13:12,172 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f064f7780ebd82e31929c68278f31645: 2023-07-14 05:13:12,172 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689311590853.f064f7780ebd82e31929c68278f31645.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,172 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 05:13:12,172 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion/f064f7780ebd82e31929c68278f31645/cf/3fbc862eb9c34727bc27d1e205dfddcc] hfiles 2023-07-14 05:13:12,172 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion/f064f7780ebd82e31929c68278f31645/cf/3fbc862eb9c34727bc27d1e205dfddcc for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,178 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion/19ccb6e05b16484cd988b85623700843/.tmp/cf/3c95ec501d8a4d6e894890bca216785e as hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion/19ccb6e05b16484cd988b85623700843/cf/3c95ec501d8a4d6e894890bca216785e 2023-07-14 05:13:12,199 INFO [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion/19ccb6e05b16484cd988b85623700843/cf/3c95ec501d8a4d6e894890bca216785e, entries=45, sequenceid=6, filesize=7.9 K 2023-07-14 05:13:12,203 INFO [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 19ccb6e05b16484cd988b85623700843 in 142ms, sequenceid=6, compaction requested=false 2023-07-14 05:13:12,224 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 19ccb6e05b16484cd988b85623700843: 2023-07-14 05:13:12,224 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689311590853.19ccb6e05b16484cd988b85623700843.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,225 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 05:13:12,225 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion/19ccb6e05b16484cd988b85623700843/cf/3c95ec501d8a4d6e894890bca216785e] hfiles 2023-07-14 05:13:12,225 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion/19ccb6e05b16484cd988b85623700843/cf/3c95ec501d8a4d6e894890bca216785e for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,230 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689311590853.f064f7780ebd82e31929c68278f31645. completed. 2023-07-14 05:13:12,230 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689311590853.f064f7780ebd82e31929c68278f31645. 2023-07-14 05:13:12,230 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 05:13:12,230 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 05:13:12,230 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:12,230 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-14 05:13:12,230 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35535,1689311513825' in zk 2023-07-14 05:13:12,233 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:12,233 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-14 05:13:12,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:12,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:13:12,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:13:12,234 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 05:13:12,234 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-14 05:13:12,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:13:12,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:13:12,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:12,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:12,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:12,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:13:12,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:12,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:12,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,35535,1689311513825': 2023-07-14 05:13:12,250 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35535,1689311513825' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-14 05:13:12,252 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689311590853.19ccb6e05b16484cd988b85623700843. completed. 2023-07-14 05:13:12,252 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689311590853.19ccb6e05b16484cd988b85623700843. 2023-07-14 05:13:12,252 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 05:13:12,252 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 05:13:12,252 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:12,252 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-14 05:13:12,252 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35487,1689311513755' in zk 2023-07-14 05:13:12,254 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:12,254 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-14 05:13:12,254 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 05:13:12,254 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-14 05:13:12,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:12,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:13:12,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:13:12,257 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 05:13:12,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:13:12,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:13:12,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 05:13:12,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-14 05:13:12,259 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 05:13:12,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:12,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:12,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:12,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:13:12,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:12,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:12,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:12,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,35487,1689311513755': 2023-07-14 05:13:12,263 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35487,1689311513755' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-14 05:13:12,263 INFO [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-14 05:13:12,263 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 05:13:12,263 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 05:13:12,263 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,263 INFO [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 05:13:12,271 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,271 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:13:12,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,271 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,271 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,271 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:13:12,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,271 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,271 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:13:12,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:13:12,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:13:12,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:13:12,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:13:12,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:13:12,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:13:12,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:13:12,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:13:12,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:13:12,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:13:12,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:12,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:12,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:12,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:13:12,275 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:12,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,276 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:12,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:12,277 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:12,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:12,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:12,279 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:12,280 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:12,280 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:12,285 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:12,285 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,285 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:12,285 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:12,285 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:13:12,285 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:13:12,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:13:12,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:13:12,285 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:13:12,285 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:13:12,285 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:13:12,285 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,285 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:12,285 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,285 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:12,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:13:12,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:13:12,285 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:13:12,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:13:12,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:13:12,285 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:12,286 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:13:12,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:13:12,286 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:13:12,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:13:12,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:13:12,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:13:12,287 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 05:13:12,287 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,290 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,293 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,384 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,463 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-14 05:13:12,463 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,464 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:12,464 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689311591946Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689311592290 (+344 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689311592290Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689311592320 (+30 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689311592354 (+34 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689311592463 (+109 ms) 2023-07-14 05:13:12,467 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-14 05:13:12,469 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 518 msec 2023-07-14 05:13:12,559 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 05:13:12,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 05:13:12,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 05:13:12,599 DEBUG [Listener at jenkins-hbase4.apache.org/38651] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-14 05:13:12,603 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33976, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-14 05:13:12,605 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35487] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-14 05:13:12,606 DEBUG [Listener at jenkins-hbase4.apache.org/38651] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-14 05:13:12,609 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55480, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-14 05:13:12,609 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35535] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-14 05:13:12,610 DEBUG [Listener at jenkins-hbase4.apache.org/38651] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-14 05:13:12,612 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44578, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-14 05:13:12,613 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43331] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-14 05:13:12,615 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-14 05:13:12,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:12,619 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 05:13:12,620 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-14 05:13:12,620 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 05:13:12,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-14 05:13:12,626 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dd0a73784a21452ab970a796258867f2 2023-07-14 05:13:12,629 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dd0a73784a21452ab970a796258867f2 empty. 2023-07-14 05:13:12,629 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a5897f41b50877f820ce85f835f16bd3 2023-07-14 05:13:12,629 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dd0a73784a21452ab970a796258867f2 2023-07-14 05:13:12,629 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a5897f41b50877f820ce85f835f16bd3 empty. 2023-07-14 05:13:12,630 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a5897f41b50877f820ce85f835f16bd3 2023-07-14 05:13:12,630 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-14 05:13:12,644 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-14 05:13:12,655 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => dd0a73784a21452ab970a796258867f2, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689311592615.dd0a73784a21452ab970a796258867f2.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp 2023-07-14 05:13:12,679 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => a5897f41b50877f820ce85f835f16bd3, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689311592615.a5897f41b50877f820ce85f835f16bd3.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp 2023-07-14 05:13:12,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-14 05:13:12,791 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689311592615.dd0a73784a21452ab970a796258867f2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 05:13:12,792 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing dd0a73784a21452ab970a796258867f2, disabling compactions & flushes 2023-07-14 05:13:12,792 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689311592615.dd0a73784a21452ab970a796258867f2. 2023-07-14 05:13:12,792 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689311592615.dd0a73784a21452ab970a796258867f2. 2023-07-14 05:13:12,792 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689311592615.dd0a73784a21452ab970a796258867f2. after waiting 0 ms 2023-07-14 05:13:12,792 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689311592615.dd0a73784a21452ab970a796258867f2. 2023-07-14 05:13:12,792 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689311592615.dd0a73784a21452ab970a796258867f2. 2023-07-14 05:13:12,792 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for dd0a73784a21452ab970a796258867f2: 2023-07-14 05:13:12,793 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689311592615.a5897f41b50877f820ce85f835f16bd3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 05:13:12,793 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing a5897f41b50877f820ce85f835f16bd3, disabling compactions & flushes 2023-07-14 05:13:12,793 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689311592615.a5897f41b50877f820ce85f835f16bd3. 2023-07-14 05:13:12,793 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689311592615.a5897f41b50877f820ce85f835f16bd3. 2023-07-14 05:13:12,794 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689311592615.a5897f41b50877f820ce85f835f16bd3. after waiting 0 ms 2023-07-14 05:13:12,794 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689311592615.a5897f41b50877f820ce85f835f16bd3. 2023-07-14 05:13:12,794 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689311592615.a5897f41b50877f820ce85f835f16bd3. 2023-07-14 05:13:12,794 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for a5897f41b50877f820ce85f835f16bd3: 2023-07-14 05:13:12,805 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 05:13:12,806 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689311592615.dd0a73784a21452ab970a796258867f2.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689311592806"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689311592806"}]},"ts":"1689311592806"} 2023-07-14 05:13:12,806 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689311592615.a5897f41b50877f820ce85f835f16bd3.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689311592806"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689311592806"}]},"ts":"1689311592806"} 2023-07-14 05:13:12,814 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 05:13:12,816 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 05:13:12,816 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689311592816"}]},"ts":"1689311592816"} 2023-07-14 05:13:12,818 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-14 05:13:12,822 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-14 05:13:12,824 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 05:13:12,824 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 05:13:12,824 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 05:13:12,824 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 05:13:12,824 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=dd0a73784a21452ab970a796258867f2, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a5897f41b50877f820ce85f835f16bd3, ASSIGN}] 2023-07-14 05:13:12,831 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=dd0a73784a21452ab970a796258867f2, ASSIGN 2023-07-14 05:13:12,831 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a5897f41b50877f820ce85f835f16bd3, ASSIGN 2023-07-14 05:13:12,832 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=dd0a73784a21452ab970a796258867f2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35535,1689311513825; forceNewPlan=false, retain=false 2023-07-14 05:13:12,833 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a5897f41b50877f820ce85f835f16bd3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43331,1689311513888; forceNewPlan=false, retain=false 2023-07-14 05:13:12,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-14 05:13:12,983 INFO [jenkins-hbase4:35845] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 05:13:12,987 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=a5897f41b50877f820ce85f835f16bd3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:12,987 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689311592615.a5897f41b50877f820ce85f835f16bd3.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689311592986"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689311592986"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689311592986"}]},"ts":"1689311592986"} 2023-07-14 05:13:12,987 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=dd0a73784a21452ab970a796258867f2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:12,987 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689311592615.dd0a73784a21452ab970a796258867f2.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689311592987"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689311592987"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689311592987"}]},"ts":"1689311592987"} 2023-07-14 05:13:13,000 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure a5897f41b50877f820ce85f835f16bd3, server=jenkins-hbase4.apache.org,43331,1689311513888}] 2023-07-14 05:13:13,001 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure dd0a73784a21452ab970a796258867f2, server=jenkins-hbase4.apache.org,35535,1689311513825}] 2023-07-14 05:13:13,160 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689311592615.a5897f41b50877f820ce85f835f16bd3. 2023-07-14 05:13:13,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a5897f41b50877f820ce85f835f16bd3, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689311592615.a5897f41b50877f820ce85f835f16bd3.', STARTKEY => '2', ENDKEY => ''} 2023-07-14 05:13:13,161 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689311592615.dd0a73784a21452ab970a796258867f2. 2023-07-14 05:13:13,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dd0a73784a21452ab970a796258867f2, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689311592615.dd0a73784a21452ab970a796258867f2.', STARTKEY => '', ENDKEY => '2'} 2023-07-14 05:13:13,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689311592615.a5897f41b50877f820ce85f835f16bd3. service=AccessControlService 2023-07-14 05:13:13,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689311592615.dd0a73784a21452ab970a796258867f2. service=AccessControlService 2023-07-14 05:13:13,162 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 05:13:13,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 a5897f41b50877f820ce85f835f16bd3 2023-07-14 05:13:13,162 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 05:13:13,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689311592615.a5897f41b50877f820ce85f835f16bd3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 05:13:13,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 dd0a73784a21452ab970a796258867f2 2023-07-14 05:13:13,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a5897f41b50877f820ce85f835f16bd3 2023-07-14 05:13:13,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689311592615.dd0a73784a21452ab970a796258867f2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 05:13:13,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a5897f41b50877f820ce85f835f16bd3 2023-07-14 05:13:13,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for dd0a73784a21452ab970a796258867f2 2023-07-14 05:13:13,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for dd0a73784a21452ab970a796258867f2 2023-07-14 05:13:13,164 INFO [StoreOpener-a5897f41b50877f820ce85f835f16bd3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a5897f41b50877f820ce85f835f16bd3 2023-07-14 05:13:13,164 INFO [StoreOpener-dd0a73784a21452ab970a796258867f2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region dd0a73784a21452ab970a796258867f2 2023-07-14 05:13:13,167 DEBUG [StoreOpener-a5897f41b50877f820ce85f835f16bd3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a5897f41b50877f820ce85f835f16bd3/cf 2023-07-14 05:13:13,167 DEBUG [StoreOpener-a5897f41b50877f820ce85f835f16bd3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a5897f41b50877f820ce85f835f16bd3/cf 2023-07-14 05:13:13,168 INFO [StoreOpener-a5897f41b50877f820ce85f835f16bd3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a5897f41b50877f820ce85f835f16bd3 columnFamilyName cf 2023-07-14 05:13:13,168 DEBUG [StoreOpener-dd0a73784a21452ab970a796258867f2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dd0a73784a21452ab970a796258867f2/cf 2023-07-14 05:13:13,168 DEBUG [StoreOpener-dd0a73784a21452ab970a796258867f2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dd0a73784a21452ab970a796258867f2/cf 2023-07-14 05:13:13,168 INFO [StoreOpener-a5897f41b50877f820ce85f835f16bd3-1] regionserver.HStore(310): Store=a5897f41b50877f820ce85f835f16bd3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 05:13:13,169 INFO [StoreOpener-dd0a73784a21452ab970a796258867f2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dd0a73784a21452ab970a796258867f2 columnFamilyName cf 2023-07-14 05:13:13,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a5897f41b50877f820ce85f835f16bd3 2023-07-14 05:13:13,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a5897f41b50877f820ce85f835f16bd3 2023-07-14 05:13:13,170 INFO [StoreOpener-dd0a73784a21452ab970a796258867f2-1] regionserver.HStore(310): Store=dd0a73784a21452ab970a796258867f2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 05:13:13,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dd0a73784a21452ab970a796258867f2 2023-07-14 05:13:13,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dd0a73784a21452ab970a796258867f2 2023-07-14 05:13:13,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a5897f41b50877f820ce85f835f16bd3 2023-07-14 05:13:13,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for dd0a73784a21452ab970a796258867f2 2023-07-14 05:13:13,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a5897f41b50877f820ce85f835f16bd3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 05:13:13,177 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a5897f41b50877f820ce85f835f16bd3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62088972, jitterRate=-0.0748022198677063}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 05:13:13,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a5897f41b50877f820ce85f835f16bd3: 2023-07-14 05:13:13,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dd0a73784a21452ab970a796258867f2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 05:13:13,178 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689311592615.a5897f41b50877f820ce85f835f16bd3., pid=69, masterSystemTime=1689311593152 2023-07-14 05:13:13,180 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened dd0a73784a21452ab970a796258867f2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60908214, jitterRate=-0.09239688515663147}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 05:13:13,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for dd0a73784a21452ab970a796258867f2: 2023-07-14 05:13:13,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689311592615.a5897f41b50877f820ce85f835f16bd3. 2023-07-14 05:13:13,181 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689311592615.a5897f41b50877f820ce85f835f16bd3. 2023-07-14 05:13:13,181 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689311592615.dd0a73784a21452ab970a796258867f2., pid=70, masterSystemTime=1689311593158 2023-07-14 05:13:13,183 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=a5897f41b50877f820ce85f835f16bd3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:13,183 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689311592615.a5897f41b50877f820ce85f835f16bd3.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689311593182"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689311593182"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689311593182"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689311593182"}]},"ts":"1689311593182"} 2023-07-14 05:13:13,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689311592615.dd0a73784a21452ab970a796258867f2. 2023-07-14 05:13:13,183 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689311592615.dd0a73784a21452ab970a796258867f2. 2023-07-14 05:13:13,183 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=dd0a73784a21452ab970a796258867f2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:13,184 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689311592615.dd0a73784a21452ab970a796258867f2.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689311593183"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689311593183"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689311593183"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689311593183"}]},"ts":"1689311593183"} 2023-07-14 05:13:13,186 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=68 2023-07-14 05:13:13,186 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure a5897f41b50877f820ce85f835f16bd3, server=jenkins-hbase4.apache.org,43331,1689311513888 in 185 msec 2023-07-14 05:13:13,191 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=67 2023-07-14 05:13:13,191 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a5897f41b50877f820ce85f835f16bd3, ASSIGN in 362 msec 2023-07-14 05:13:13,191 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure dd0a73784a21452ab970a796258867f2, server=jenkins-hbase4.apache.org,35535,1689311513825 in 184 msec 2023-07-14 05:13:13,193 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-14 05:13:13,193 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=dd0a73784a21452ab970a796258867f2, ASSIGN in 367 msec 2023-07-14 05:13:13,194 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 05:13:13,194 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689311593194"}]},"ts":"1689311593194"} 2023-07-14 05:13:13,196 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-14 05:13:13,198 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 05:13:13,199 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-14 05:13:13,208 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35487] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-14 05:13:13,209 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 05:13:13,209 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 05:13:13,209 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 05:13:13,209 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 05:13:13,214 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 05:13:13,214 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-14 05:13:13,214 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 05:13:13,214 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-14 05:13:13,215 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 598 msec 2023-07-14 05:13:13,215 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 05:13:13,215 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 05:13:13,215 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-14 05:13:13,215 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-14 05:13:13,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-14 05:13:13,228 INFO [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-14 05:13:13,270 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions dd0a73784a21452ab970a796258867f2, a5897f41b50877f820ce85f835f16bd3 2023-07-14 05:13:13,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[dd0a73784a21452ab970a796258867f2, a5897f41b50877f820ce85f835f16bd3], force=true 2023-07-14 05:13:13,288 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[dd0a73784a21452ab970a796258867f2, a5897f41b50877f820ce85f835f16bd3], force=true 2023-07-14 05:13:13,288 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[dd0a73784a21452ab970a796258867f2, a5897f41b50877f820ce85f835f16bd3], force=true 2023-07-14 05:13:13,288 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[dd0a73784a21452ab970a796258867f2, a5897f41b50877f820ce85f835f16bd3], force=true 2023-07-14 05:13:13,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-14 05:13:13,379 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=dd0a73784a21452ab970a796258867f2, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a5897f41b50877f820ce85f835f16bd3, UNASSIGN}] 2023-07-14 05:13:13,381 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=dd0a73784a21452ab970a796258867f2, UNASSIGN 2023-07-14 05:13:13,382 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a5897f41b50877f820ce85f835f16bd3, UNASSIGN 2023-07-14 05:13:13,387 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=dd0a73784a21452ab970a796258867f2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:13,387 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=a5897f41b50877f820ce85f835f16bd3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:13,387 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689311592615.dd0a73784a21452ab970a796258867f2.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689311593387"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689311593387"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689311593387"}]},"ts":"1689311593387"} 2023-07-14 05:13:13,387 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689311592615.a5897f41b50877f820ce85f835f16bd3.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689311593387"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689311593387"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689311593387"}]},"ts":"1689311593387"} 2023-07-14 05:13:13,389 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure a5897f41b50877f820ce85f835f16bd3, server=jenkins-hbase4.apache.org,43331,1689311513888}] 2023-07-14 05:13:13,390 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure dd0a73784a21452ab970a796258867f2, server=jenkins-hbase4.apache.org,35535,1689311513825}] 2023-07-14 05:13:13,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-14 05:13:13,542 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a5897f41b50877f820ce85f835f16bd3 2023-07-14 05:13:13,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a5897f41b50877f820ce85f835f16bd3, disabling compactions & flushes 2023-07-14 05:13:13,544 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689311592615.a5897f41b50877f820ce85f835f16bd3. 2023-07-14 05:13:13,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689311592615.a5897f41b50877f820ce85f835f16bd3. 2023-07-14 05:13:13,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689311592615.a5897f41b50877f820ce85f835f16bd3. after waiting 0 ms 2023-07-14 05:13:13,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689311592615.a5897f41b50877f820ce85f835f16bd3. 2023-07-14 05:13:13,544 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing a5897f41b50877f820ce85f835f16bd3 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-14 05:13:13,546 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close dd0a73784a21452ab970a796258867f2 2023-07-14 05:13:13,548 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing dd0a73784a21452ab970a796258867f2, disabling compactions & flushes 2023-07-14 05:13:13,548 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689311592615.dd0a73784a21452ab970a796258867f2. 2023-07-14 05:13:13,548 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689311592615.dd0a73784a21452ab970a796258867f2. 2023-07-14 05:13:13,548 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689311592615.dd0a73784a21452ab970a796258867f2. after waiting 0 ms 2023-07-14 05:13:13,548 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689311592615.dd0a73784a21452ab970a796258867f2. 2023-07-14 05:13:13,548 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing dd0a73784a21452ab970a796258867f2 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-14 05:13:13,589 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a5897f41b50877f820ce85f835f16bd3/.tmp/cf/2f997eb9b32444d5a9e47a1794a3f0b7 2023-07-14 05:13:13,592 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dd0a73784a21452ab970a796258867f2/.tmp/cf/002aad74ac1444b9809488ed09ce6fe8 2023-07-14 05:13:13,597 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a5897f41b50877f820ce85f835f16bd3/.tmp/cf/2f997eb9b32444d5a9e47a1794a3f0b7 as hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a5897f41b50877f820ce85f835f16bd3/cf/2f997eb9b32444d5a9e47a1794a3f0b7 2023-07-14 05:13:13,604 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dd0a73784a21452ab970a796258867f2/.tmp/cf/002aad74ac1444b9809488ed09ce6fe8 as hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dd0a73784a21452ab970a796258867f2/cf/002aad74ac1444b9809488ed09ce6fe8 2023-07-14 05:13:13,618 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a5897f41b50877f820ce85f835f16bd3/cf/2f997eb9b32444d5a9e47a1794a3f0b7, entries=1, sequenceid=5, filesize=4.7 K 2023-07-14 05:13:13,619 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dd0a73784a21452ab970a796258867f2/cf/002aad74ac1444b9809488ed09ce6fe8, entries=1, sequenceid=5, filesize=4.7 K 2023-07-14 05:13:13,623 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for dd0a73784a21452ab970a796258867f2 in 75ms, sequenceid=5, compaction requested=false 2023-07-14 05:13:13,623 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-14 05:13:13,624 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for a5897f41b50877f820ce85f835f16bd3 in 80ms, sequenceid=5, compaction requested=false 2023-07-14 05:13:13,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-14 05:13:13,651 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dd0a73784a21452ab970a796258867f2/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-14 05:13:13,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 05:13:13,652 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689311592615.dd0a73784a21452ab970a796258867f2. 2023-07-14 05:13:13,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for dd0a73784a21452ab970a796258867f2: 2023-07-14 05:13:13,653 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a5897f41b50877f820ce85f835f16bd3/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-14 05:13:13,654 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed dd0a73784a21452ab970a796258867f2 2023-07-14 05:13:13,654 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 05:13:13,654 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689311592615.a5897f41b50877f820ce85f835f16bd3. 2023-07-14 05:13:13,654 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a5897f41b50877f820ce85f835f16bd3: 2023-07-14 05:13:13,658 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=dd0a73784a21452ab970a796258867f2, regionState=CLOSED 2023-07-14 05:13:13,658 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689311592615.dd0a73784a21452ab970a796258867f2.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689311593658"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689311593658"}]},"ts":"1689311593658"} 2023-07-14 05:13:13,658 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a5897f41b50877f820ce85f835f16bd3 2023-07-14 05:13:13,658 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=a5897f41b50877f820ce85f835f16bd3, regionState=CLOSED 2023-07-14 05:13:13,659 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689311592615.a5897f41b50877f820ce85f835f16bd3.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689311593658"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689311593658"}]},"ts":"1689311593658"} 2023-07-14 05:13:13,666 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=72 2023-07-14 05:13:13,666 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure dd0a73784a21452ab970a796258867f2, server=jenkins-hbase4.apache.org,35535,1689311513825 in 272 msec 2023-07-14 05:13:13,667 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=73 2023-07-14 05:13:13,667 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure a5897f41b50877f820ce85f835f16bd3, server=jenkins-hbase4.apache.org,43331,1689311513888 in 276 msec 2023-07-14 05:13:13,669 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=dd0a73784a21452ab970a796258867f2, UNASSIGN in 292 msec 2023-07-14 05:13:13,670 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=71 2023-07-14 05:13:13,671 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a5897f41b50877f820ce85f835f16bd3, UNASSIGN in 288 msec 2023-07-14 05:13:13,828 DEBUG [PEWorker-3] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e86628cd601cd5da64cbc2a4990f5b24/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-14 05:13:13,832 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689311592615.dd0a73784a21452ab970a796258867f2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-14 05:13:13,832 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689311592615.a5897f41b50877f820ce85f835f16bd3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-14 05:13:13,832 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689311592616.e86628cd601cd5da64cbc2a4990f5b24.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-14 05:13:13,898 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e86628cd601cd5da64cbc2a4990f5b24, ASSIGN}] 2023-07-14 05:13:13,899 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e86628cd601cd5da64cbc2a4990f5b24, ASSIGN 2023-07-14 05:13:13,902 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e86628cd601cd5da64cbc2a4990f5b24, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,35535,1689311513825; forceNewPlan=false, retain=false 2023-07-14 05:13:13,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-14 05:13:14,052 INFO [jenkins-hbase4:35845] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-14 05:13:14,054 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=e86628cd601cd5da64cbc2a4990f5b24, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:14,055 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689311592616.e86628cd601cd5da64cbc2a4990f5b24.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689311594054"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689311594054"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689311594054"}]},"ts":"1689311594054"} 2023-07-14 05:13:14,057 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure e86628cd601cd5da64cbc2a4990f5b24, server=jenkins-hbase4.apache.org,35535,1689311513825}] 2023-07-14 05:13:14,213 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689311592616.e86628cd601cd5da64cbc2a4990f5b24. 2023-07-14 05:13:14,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e86628cd601cd5da64cbc2a4990f5b24, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689311592616.e86628cd601cd5da64cbc2a4990f5b24.', STARTKEY => '', ENDKEY => ''} 2023-07-14 05:13:14,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689311592616.e86628cd601cd5da64cbc2a4990f5b24. service=AccessControlService 2023-07-14 05:13:14,214 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 05:13:14,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 e86628cd601cd5da64cbc2a4990f5b24 2023-07-14 05:13:14,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689311592616.e86628cd601cd5da64cbc2a4990f5b24.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 05:13:14,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e86628cd601cd5da64cbc2a4990f5b24 2023-07-14 05:13:14,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e86628cd601cd5da64cbc2a4990f5b24 2023-07-14 05:13:14,217 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e86628cd601cd5da64cbc2a4990f5b24/.regioninfo 2023-07-14 05:13:14,233 INFO [StoreOpener-e86628cd601cd5da64cbc2a4990f5b24-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e86628cd601cd5da64cbc2a4990f5b24 2023-07-14 05:13:14,234 DEBUG [StoreOpener-e86628cd601cd5da64cbc2a4990f5b24-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e86628cd601cd5da64cbc2a4990f5b24/cf 2023-07-14 05:13:14,234 DEBUG [StoreOpener-e86628cd601cd5da64cbc2a4990f5b24-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e86628cd601cd5da64cbc2a4990f5b24/cf 2023-07-14 05:13:14,234 INFO [StoreOpener-e86628cd601cd5da64cbc2a4990f5b24-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e86628cd601cd5da64cbc2a4990f5b24 columnFamilyName cf 2023-07-14 05:13:14,273 DEBUG [StoreOpener-e86628cd601cd5da64cbc2a4990f5b24-1] regionserver.HStore(539): loaded hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e86628cd601cd5da64cbc2a4990f5b24/cf/002aad74ac1444b9809488ed09ce6fe8.dd0a73784a21452ab970a796258867f2->hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dd0a73784a21452ab970a796258867f2/cf/002aad74ac1444b9809488ed09ce6fe8-top 2023-07-14 05:13:14,280 DEBUG [StoreOpener-e86628cd601cd5da64cbc2a4990f5b24-1] regionserver.HStore(539): loaded hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e86628cd601cd5da64cbc2a4990f5b24/cf/2f997eb9b32444d5a9e47a1794a3f0b7.a5897f41b50877f820ce85f835f16bd3->hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a5897f41b50877f820ce85f835f16bd3/cf/2f997eb9b32444d5a9e47a1794a3f0b7-top 2023-07-14 05:13:14,281 INFO [StoreOpener-e86628cd601cd5da64cbc2a4990f5b24-1] regionserver.HStore(310): Store=e86628cd601cd5da64cbc2a4990f5b24/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 05:13:14,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e86628cd601cd5da64cbc2a4990f5b24 2023-07-14 05:13:14,284 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e86628cd601cd5da64cbc2a4990f5b24 2023-07-14 05:13:14,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e86628cd601cd5da64cbc2a4990f5b24 2023-07-14 05:13:14,290 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e86628cd601cd5da64cbc2a4990f5b24; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72369756, jitterRate=0.07839339971542358}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 05:13:14,290 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e86628cd601cd5da64cbc2a4990f5b24: 2023-07-14 05:13:14,291 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689311592616.e86628cd601cd5da64cbc2a4990f5b24., pid=77, masterSystemTime=1689311594209 2023-07-14 05:13:14,291 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689311592616.e86628cd601cd5da64cbc2a4990f5b24.,because compaction is disabled. 2023-07-14 05:13:14,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689311592616.e86628cd601cd5da64cbc2a4990f5b24. 2023-07-14 05:13:14,293 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689311592616.e86628cd601cd5da64cbc2a4990f5b24. 2023-07-14 05:13:14,293 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=e86628cd601cd5da64cbc2a4990f5b24, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:14,294 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689311592616.e86628cd601cd5da64cbc2a4990f5b24.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689311594293"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689311594293"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689311594293"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689311594293"}]},"ts":"1689311594293"} 2023-07-14 05:13:14,299 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-14 05:13:14,299 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure e86628cd601cd5da64cbc2a4990f5b24, server=jenkins-hbase4.apache.org,35535,1689311513825 in 238 msec 2023-07-14 05:13:14,303 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-14 05:13:14,304 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e86628cd601cd5da64cbc2a4990f5b24, ASSIGN in 401 msec 2023-07-14 05:13:14,305 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[dd0a73784a21452ab970a796258867f2, a5897f41b50877f820ce85f835f16bd3], force=true in 1.0300 sec 2023-07-14 05:13:14,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-14 05:13:14,449 INFO [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-14 05:13:14,450 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-14 05:13:14,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689311594450 (current time:1689311594450). 2023-07-14 05:13:14,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 05:13:14,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] zookeeper.ReadOnlyZKClient(139): Connect 0x4117095b to 127.0.0.1:55310 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 05:13:14,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a70ec68, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 05:13:14,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 05:13:14,462 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44594, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 05:13:14,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4117095b to 127.0.0.1:55310 2023-07-14 05:13:14,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 05:13:14,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] zookeeper.ReadOnlyZKClient(139): Connect 0x2b9b5938 to 127.0.0.1:55310 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 05:13:14,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52bfd0c1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 05:13:14,471 DEBUG [hconnection-0x4fb16552-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 05:13:14,474 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44606, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 05:13:14,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 05:13:14,480 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33992, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 05:13:14,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2b9b5938 to 127.0.0.1:55310 2023-07-14 05:13:14,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 05:13:14,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-14 05:13:14,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 05:13:14,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-14 05:13:14,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-14 05:13:14,485 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-14 05:13:14,486 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689312194486 2023-07-14 05:13:14,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-14 05:13:14,486 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,491 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 05:13:14,491 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 05:13:14,492 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-14 05:13:14,492 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-14 05:13:14,493 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 9 msec 2023-07-14 05:13:14,494 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-14 05:13:14,495 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689312194495 2023-07-14 05:13:14,512 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,512 INFO [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-14 05:13:14,512 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 05:13:14,514 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-14 05:13:14,514 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-14 05:13:14,514 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,514 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,516 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:13:14,516 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:13:14,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:13:14,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:13:14,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:13:14,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:13:14,516 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:14,516 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:13:14,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:13:14,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:13:14,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,519 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:14,519 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 05:13:14,519 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,519 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,519 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-14 05:13:14,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-14 05:13:14,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,520 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-14 05:13:14,520 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-14 05:13:14,520 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-14 05:13:14,520 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,520 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-14 05:13:14,520 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-14 05:13:14,520 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 05:13:14,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,522 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-14 05:13:14,522 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-14 05:13:14,520 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 05:13:14,522 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-14 05:13:14,522 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35535,1689311513825' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-14 05:13:14,523 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-14 05:13:14,523 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-14 05:13:14,523 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43331,1689311513888' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-14 05:13:14,523 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,523 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-14 05:13:14,523 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 05:13:14,525 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-14 05:13:14,525 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-14 05:13:14,525 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35487,1689311513755' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-14 05:13:14,526 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,528 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,528 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,528 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 05:13:14,529 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,529 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,529 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 05:13:14,529 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:14,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:14,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:13:14,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:13:14,529 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,529 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 05:13:14,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:13:14,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:13:14,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:14,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:14,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:14,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:13:14,531 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35535,1689311513825' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-14 05:13:14,532 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5afb3958[Count = 0] remaining members to acquire global barrier 2023-07-14 05:13:14,532 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-14 05:13:14,532 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,533 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,533 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,533 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,533 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:14,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,533 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 05:13:14,533 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-14 05:13:14,533 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-14 05:13:14,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,533 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-14 05:13:14,533 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-14 05:13:14,533 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689311592616.e86628cd601cd5da64cbc2a4990f5b24. 2023-07-14 05:13:14,533 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-14 05:13:14,533 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,43331,1689311513888' in zk 2023-07-14 05:13:14,534 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,35487,1689311513755' in zk 2023-07-14 05:13:14,533 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 05:13:14,534 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 05:13:14,534 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689311592616.e86628cd601cd5da64cbc2a4990f5b24. started... 2023-07-14 05:13:14,535 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e86628cd601cd5da64cbc2a4990f5b24: 2023-07-14 05:13:14,536 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689311592616.e86628cd601cd5da64cbc2a4990f5b24.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,536 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 05:13:14,536 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e86628cd601cd5da64cbc2a4990f5b24/cf/002aad74ac1444b9809488ed09ce6fe8.dd0a73784a21452ab970a796258867f2->hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dd0a73784a21452ab970a796258867f2/cf/002aad74ac1444b9809488ed09ce6fe8-top, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e86628cd601cd5da64cbc2a4990f5b24/cf/2f997eb9b32444d5a9e47a1794a3f0b7.a5897f41b50877f820ce85f835f16bd3->hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a5897f41b50877f820ce85f835f16bd3/cf/2f997eb9b32444d5a9e47a1794a3f0b7-top] hfiles 2023-07-14 05:13:14,536 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e86628cd601cd5da64cbc2a4990f5b24/cf/002aad74ac1444b9809488ed09ce6fe8.dd0a73784a21452ab970a796258867f2 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,536 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-14 05:13:14,536 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 05:13:14,536 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-14 05:13:14,538 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e86628cd601cd5da64cbc2a4990f5b24/cf/2f997eb9b32444d5a9e47a1794a3f0b7.a5897f41b50877f820ce85f835f16bd3 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,542 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-14 05:13:14,542 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 05:13:14,542 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-14 05:13:14,555 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689311592616.e86628cd601cd5da64cbc2a4990f5b24. completed. 2023-07-14 05:13:14,555 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689311592616.e86628cd601cd5da64cbc2a4990f5b24. 2023-07-14 05:13:14,556 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 05:13:14,556 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 05:13:14,556 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:14,556 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-14 05:13:14,556 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,35535,1689311513825' in zk 2023-07-14 05:13:14,565 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:14,565 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-14 05:13:14,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:14,565 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 05:13:14,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:13:14,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:13:14,565 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-14 05:13:14,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:13:14,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:13:14,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:14,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:14,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:14,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:13:14,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:14,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:14,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:14,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,35535,1689311513825': 2023-07-14 05:13:14,571 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35535,1689311513825' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-14 05:13:14,571 INFO [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-14 05:13:14,572 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 05:13:14,572 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 05:13:14,572 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,572 INFO [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 05:13:14,574 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,574 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:13:14,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:13:14,574 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:13:14,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:13:14,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:13:14,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:13:14,574 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:14,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,575 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,575 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,575 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:13:14,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,575 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:14,575 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:13:14,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:13:14,576 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:14,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:13:14,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:13:14,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:13:14,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:13:14,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:14,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:14,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:14,578 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:14,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:13:14,578 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:14,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,579 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:14,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:14,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:14,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:14,583 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:13:14,583 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:13:14,583 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:13:14,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:13:14,584 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 05:13:14,584 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:13:14,584 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,584 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:13:14,584 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:13:14,584 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:13:14,584 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:14,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:13:14,584 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:13:14,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:13:14,584 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:14,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:13:14,585 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:14,585 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,585 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:14,585 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,585 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:14,585 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:14,585 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,585 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:13:14,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:13:14,585 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:13:14,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:13:14,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:13:14,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:13:14,591 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 05:13:14,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-14 05:13:14,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-14 05:13:14,593 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 05:13:14,635 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,692 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689311521774_0004_000001 (auth:SIMPLE) 2023-07-14 05:13:14,701 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-14 05:13:14,701 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,701 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,701 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689311594486Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689311594584 (+98 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689311594584Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689311594588 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689311594615 (+27 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689311594701 (+86 ms) 2023-07-14 05:13:14,703 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-14 05:13:14,705 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 212 msec 2023-07-14 05:13:14,793 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 05:13:14,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-14 05:13:14,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 05:13:14,794 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/export-test/export-1689311594794 2023-07-14 05:13:14,795 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36535, tgtDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/export-test/export-1689311594794, rawTgtDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/export-test/export-1689311594794, srcFsUri=hdfs://localhost:36535, srcDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48 2023-07-14 05:13:14,819 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36535, inputRoot=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48 2023-07-14 05:13:14,819 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2030399887_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/export-test/export-1689311594794, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/export-test/export-1689311594794/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,819 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36535, inputRoot=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48, snapshotDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-14 05:13:14,828 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/export-test/export-1689311594794/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:14,861 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 05:13:14,862 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 05:13:14,862 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 05:13:14,862 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 05:13:14,863 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-14 05:13:14,863 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 05:13:14,863 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 05:13:14,940 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/hadoop-5393083615197950385.jar 2023-07-14 05:13:14,940 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 05:13:14,940 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 05:13:14,941 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 05:13:14,941 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 05:13:14,941 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 05:13:14,942 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 05:13:14,942 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 05:13:14,942 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 05:13:14,943 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 05:13:14,943 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 05:13:14,944 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 05:13:14,944 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 05:13:14,944 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 05:13:14,945 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 05:13:14,945 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 05:13:14,945 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 05:13:14,946 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 05:13:14,946 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 05:13:14,946 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 05:13:14,947 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 05:13:14,947 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 05:13:14,947 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 05:13:14,948 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 05:13:15,851 WARN [Listener at jenkins-hbase4.apache.org/38651] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 05:13:15,857 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-14 05:13:15,863 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-14 05:13:15,979 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 05:13:15,979 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 05:13:16,174 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 05:13:16,431 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689311521774_0005_000001 (auth:SIMPLE) 2023-07-14 05:13:21,962 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689311521774_0005_000001 (auth:SIMPLE) 2023-07-14 05:13:24,253 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689311521774_0005_000001 (auth:SIMPLE) 2023-07-14 05:13:28,055 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689311521774_0005_000001 (auth:SIMPLE) 2023-07-14 05:13:29,432 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 05:13:29,433 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 05:13:29,484 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:29,484 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 05:13:29,485 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 05:13:29,485 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-839015254_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:29,486 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(367): hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-14 05:13:29,486 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(367): hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-14 05:13:29,486 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-839015254_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/export-test/export-1689311594794/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/export-test/export-1689311594794/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:29,487 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(367): hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/export-test/export-1689311594794/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-14 05:13:29,487 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(367): hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/export-test/export-1689311594794/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-14 05:13:29,514 INFO [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:29,514 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:29,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:29,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-14 05:13:29,526 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689311609526"}]},"ts":"1689311609526"} 2023-07-14 05:13:29,531 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-14 05:13:29,534 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-14 05:13:29,535 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e86628cd601cd5da64cbc2a4990f5b24, UNASSIGN}] 2023-07-14 05:13:29,540 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e86628cd601cd5da64cbc2a4990f5b24, UNASSIGN 2023-07-14 05:13:29,541 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=e86628cd601cd5da64cbc2a4990f5b24, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:29,541 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689311592616.e86628cd601cd5da64cbc2a4990f5b24.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689311609541"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689311609541"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689311609541"}]},"ts":"1689311609541"} 2023-07-14 05:13:29,543 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure e86628cd601cd5da64cbc2a4990f5b24, server=jenkins-hbase4.apache.org,35535,1689311513825}] 2023-07-14 05:13:29,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-14 05:13:29,696 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e86628cd601cd5da64cbc2a4990f5b24 2023-07-14 05:13:29,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e86628cd601cd5da64cbc2a4990f5b24, disabling compactions & flushes 2023-07-14 05:13:29,696 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689311592616.e86628cd601cd5da64cbc2a4990f5b24. 2023-07-14 05:13:29,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689311592616.e86628cd601cd5da64cbc2a4990f5b24. 2023-07-14 05:13:29,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689311592616.e86628cd601cd5da64cbc2a4990f5b24. after waiting 0 ms 2023-07-14 05:13:29,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689311592616.e86628cd601cd5da64cbc2a4990f5b24. 2023-07-14 05:13:29,710 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e86628cd601cd5da64cbc2a4990f5b24/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-14 05:13:29,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 05:13:29,712 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689311592616.e86628cd601cd5da64cbc2a4990f5b24. 2023-07-14 05:13:29,712 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e86628cd601cd5da64cbc2a4990f5b24: 2023-07-14 05:13:29,714 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e86628cd601cd5da64cbc2a4990f5b24 2023-07-14 05:13:29,714 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=e86628cd601cd5da64cbc2a4990f5b24, regionState=CLOSED 2023-07-14 05:13:29,714 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689311592616.e86628cd601cd5da64cbc2a4990f5b24.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689311609714"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689311609714"}]},"ts":"1689311609714"} 2023-07-14 05:13:29,718 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-14 05:13:29,718 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure e86628cd601cd5da64cbc2a4990f5b24, server=jenkins-hbase4.apache.org,35535,1689311513825 in 173 msec 2023-07-14 05:13:29,719 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-14 05:13:29,720 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e86628cd601cd5da64cbc2a4990f5b24, UNASSIGN in 183 msec 2023-07-14 05:13:29,720 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689311609720"}]},"ts":"1689311609720"} 2023-07-14 05:13:29,722 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-14 05:13:29,724 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-14 05:13:29,726 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 210 msec 2023-07-14 05:13:29,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-14 05:13:29,826 INFO [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-14 05:13:29,827 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:29,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:29,831 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:29,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:29,832 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:29,834 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35487] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:29,837 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:29,837 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:29,837 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:29,838 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-14 05:13:29,837 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:29,838 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-14 05:13:29,838 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-14 05:13:29,838 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-14 05:13:29,840 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e86628cd601cd5da64cbc2a4990f5b24 2023-07-14 05:13:29,842 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:29,842 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 05:13:29,842 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:29,842 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:29,842 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:29,842 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 05:13:29,842 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 05:13:29,842 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 05:13:29,843 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 05:13:29,843 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 05:13:29,843 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 05:13:29,843 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 05:13:29,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-14 05:13:29,849 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a5897f41b50877f820ce85f835f16bd3 2023-07-14 05:13:29,849 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dd0a73784a21452ab970a796258867f2 2023-07-14 05:13:29,853 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e86628cd601cd5da64cbc2a4990f5b24/cf, FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e86628cd601cd5da64cbc2a4990f5b24/recovered.edits] 2023-07-14 05:13:29,855 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a5897f41b50877f820ce85f835f16bd3/cf, FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a5897f41b50877f820ce85f835f16bd3/recovered.edits] 2023-07-14 05:13:29,857 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dd0a73784a21452ab970a796258867f2/cf, FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dd0a73784a21452ab970a796258867f2/recovered.edits] 2023-07-14 05:13:29,865 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a5897f41b50877f820ce85f835f16bd3/cf/2f997eb9b32444d5a9e47a1794a3f0b7 to hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a5897f41b50877f820ce85f835f16bd3/cf/2f997eb9b32444d5a9e47a1794a3f0b7 2023-07-14 05:13:29,872 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e86628cd601cd5da64cbc2a4990f5b24/cf/002aad74ac1444b9809488ed09ce6fe8.dd0a73784a21452ab970a796258867f2 to hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e86628cd601cd5da64cbc2a4990f5b24/cf/002aad74ac1444b9809488ed09ce6fe8.dd0a73784a21452ab970a796258867f2 2023-07-14 05:13:29,874 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e86628cd601cd5da64cbc2a4990f5b24/cf/2f997eb9b32444d5a9e47a1794a3f0b7.a5897f41b50877f820ce85f835f16bd3 to hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e86628cd601cd5da64cbc2a4990f5b24/cf/2f997eb9b32444d5a9e47a1794a3f0b7.a5897f41b50877f820ce85f835f16bd3 2023-07-14 05:13:29,877 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dd0a73784a21452ab970a796258867f2/cf/002aad74ac1444b9809488ed09ce6fe8 to hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dd0a73784a21452ab970a796258867f2/cf/002aad74ac1444b9809488ed09ce6fe8 2023-07-14 05:13:29,877 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a5897f41b50877f820ce85f835f16bd3/recovered.edits/8.seqid to hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a5897f41b50877f820ce85f835f16bd3/recovered.edits/8.seqid 2023-07-14 05:13:29,878 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a5897f41b50877f820ce85f835f16bd3 2023-07-14 05:13:29,881 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e86628cd601cd5da64cbc2a4990f5b24/recovered.edits/12.seqid to hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e86628cd601cd5da64cbc2a4990f5b24/recovered.edits/12.seqid 2023-07-14 05:13:29,882 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e86628cd601cd5da64cbc2a4990f5b24 2023-07-14 05:13:29,886 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dd0a73784a21452ab970a796258867f2/recovered.edits/8.seqid to hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dd0a73784a21452ab970a796258867f2/recovered.edits/8.seqid 2023-07-14 05:13:29,886 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dd0a73784a21452ab970a796258867f2 2023-07-14 05:13:29,886 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-14 05:13:29,889 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:29,913 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-14 05:13:29,923 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-14 05:13:29,925 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:29,925 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-14 05:13:29,925 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689311592616.e86628cd601cd5da64cbc2a4990f5b24.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689311609925"}]},"ts":"9223372036854775807"} 2023-07-14 05:13:29,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-14 05:13:29,948 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-14 05:13:29,948 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e86628cd601cd5da64cbc2a4990f5b24, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689311592616.e86628cd601cd5da64cbc2a4990f5b24.', STARTKEY => '', ENDKEY => ''}] 2023-07-14 05:13:29,948 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-14 05:13:29,948 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689311609948"}]},"ts":"9223372036854775807"} 2023-07-14 05:13:29,956 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-14 05:13:29,959 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:29,962 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 132 msec 2023-07-14 05:13:30,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-14 05:13:30,147 INFO [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-14 05:13:30,147 INFO [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:30,148 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:30,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:30,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-14 05:13:30,154 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689311610154"}]},"ts":"1689311610154"} 2023-07-14 05:13:30,155 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-14 05:13:30,161 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-14 05:13:30,162 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f064f7780ebd82e31929c68278f31645, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=19ccb6e05b16484cd988b85623700843, UNASSIGN}] 2023-07-14 05:13:30,165 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f064f7780ebd82e31929c68278f31645, UNASSIGN 2023-07-14 05:13:30,165 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=19ccb6e05b16484cd988b85623700843, UNASSIGN 2023-07-14 05:13:30,167 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=f064f7780ebd82e31929c68278f31645, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:30,167 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689311590853.f064f7780ebd82e31929c68278f31645.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689311610167"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689311610167"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689311610167"}]},"ts":"1689311610167"} 2023-07-14 05:13:30,167 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=19ccb6e05b16484cd988b85623700843, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:30,168 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689311590853.19ccb6e05b16484cd988b85623700843.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689311610167"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689311610167"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689311610167"}]},"ts":"1689311610167"} 2023-07-14 05:13:30,169 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure f064f7780ebd82e31929c68278f31645, server=jenkins-hbase4.apache.org,35535,1689311513825}] 2023-07-14 05:13:30,175 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 19ccb6e05b16484cd988b85623700843, server=jenkins-hbase4.apache.org,35487,1689311513755}] 2023-07-14 05:13:30,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-14 05:13:30,326 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f064f7780ebd82e31929c68278f31645 2023-07-14 05:13:30,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f064f7780ebd82e31929c68278f31645, disabling compactions & flushes 2023-07-14 05:13:30,326 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689311590853.f064f7780ebd82e31929c68278f31645. 2023-07-14 05:13:30,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689311590853.f064f7780ebd82e31929c68278f31645. 2023-07-14 05:13:30,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689311590853.f064f7780ebd82e31929c68278f31645. after waiting 0 ms 2023-07-14 05:13:30,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689311590853.f064f7780ebd82e31929c68278f31645. 2023-07-14 05:13:30,329 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 19ccb6e05b16484cd988b85623700843 2023-07-14 05:13:30,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 19ccb6e05b16484cd988b85623700843, disabling compactions & flushes 2023-07-14 05:13:30,329 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689311590853.19ccb6e05b16484cd988b85623700843. 2023-07-14 05:13:30,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689311590853.19ccb6e05b16484cd988b85623700843. 2023-07-14 05:13:30,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689311590853.19ccb6e05b16484cd988b85623700843. after waiting 0 ms 2023-07-14 05:13:30,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689311590853.19ccb6e05b16484cd988b85623700843. 2023-07-14 05:13:30,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion/19ccb6e05b16484cd988b85623700843/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 05:13:30,399 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithMergeRegion/f064f7780ebd82e31929c68278f31645/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 05:13:30,399 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 05:13:30,400 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689311590853.19ccb6e05b16484cd988b85623700843. 2023-07-14 05:13:30,400 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 19ccb6e05b16484cd988b85623700843: 2023-07-14 05:13:30,401 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 05:13:30,402 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689311590853.f064f7780ebd82e31929c68278f31645. 2023-07-14 05:13:30,402 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f064f7780ebd82e31929c68278f31645: 2023-07-14 05:13:30,404 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 19ccb6e05b16484cd988b85623700843 2023-07-14 05:13:30,405 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=19ccb6e05b16484cd988b85623700843, regionState=CLOSED 2023-07-14 05:13:30,405 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689311590853.19ccb6e05b16484cd988b85623700843.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689311610405"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689311610405"}]},"ts":"1689311610405"} 2023-07-14 05:13:30,406 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f064f7780ebd82e31929c68278f31645 2023-07-14 05:13:30,408 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=f064f7780ebd82e31929c68278f31645, regionState=CLOSED 2023-07-14 05:13:30,408 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689311590853.f064f7780ebd82e31929c68278f31645.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689311610408"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689311610408"}]},"ts":"1689311610408"} 2023-07-14 05:13:30,415 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-14 05:13:30,415 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 19ccb6e05b16484cd988b85623700843, server=jenkins-hbase4.apache.org,35487,1689311513755 in 233 msec 2023-07-14 05:13:30,417 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=19ccb6e05b16484cd988b85623700843, UNASSIGN in 253 msec 2023-07-14 05:13:30,419 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-14 05:13:30,419 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure f064f7780ebd82e31929c68278f31645, server=jenkins-hbase4.apache.org,35535,1689311513825 in 246 msec 2023-07-14 05:13:30,421 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-14 05:13:30,421 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f064f7780ebd82e31929c68278f31645, UNASSIGN in 257 msec 2023-07-14 05:13:30,422 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689311610422"}]},"ts":"1689311610422"} 2023-07-14 05:13:30,424 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-14 05:13:30,426 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-14 05:13:30,429 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 279 msec 2023-07-14 05:13:30,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-14 05:13:30,464 INFO [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-14 05:13:30,465 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:30,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:30,470 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:30,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:30,471 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:30,472 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35487] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:30,475 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:30,475 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:30,475 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:30,475 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:30,475 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-14 05:13:30,475 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-14 05:13:30,476 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-14 05:13:30,477 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-14 05:13:30,477 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:30,478 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:30,478 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 05:13:30,477 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:30,479 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 05:13:30,477 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:30,483 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 05:13:30,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-14 05:13:30,478 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 05:13:30,485 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f064f7780ebd82e31929c68278f31645 2023-07-14 05:13:30,485 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/19ccb6e05b16484cd988b85623700843 2023-07-14 05:13:30,488 DEBUG [HFileArchiver-16] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/19ccb6e05b16484cd988b85623700843/cf, FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/19ccb6e05b16484cd988b85623700843/recovered.edits] 2023-07-14 05:13:30,488 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f064f7780ebd82e31929c68278f31645/cf, FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f064f7780ebd82e31929c68278f31645/recovered.edits] 2023-07-14 05:13:30,494 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/19ccb6e05b16484cd988b85623700843/cf/3c95ec501d8a4d6e894890bca216785e to hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/19ccb6e05b16484cd988b85623700843/cf/3c95ec501d8a4d6e894890bca216785e 2023-07-14 05:13:30,495 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f064f7780ebd82e31929c68278f31645/cf/3fbc862eb9c34727bc27d1e205dfddcc to hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/f064f7780ebd82e31929c68278f31645/cf/3fbc862eb9c34727bc27d1e205dfddcc 2023-07-14 05:13:30,500 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/19ccb6e05b16484cd988b85623700843/recovered.edits/9.seqid to hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/19ccb6e05b16484cd988b85623700843/recovered.edits/9.seqid 2023-07-14 05:13:30,501 DEBUG [HFileArchiver-16] backup.HFileArchiver(596): Deleted hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/19ccb6e05b16484cd988b85623700843 2023-07-14 05:13:30,503 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f064f7780ebd82e31929c68278f31645/recovered.edits/9.seqid to hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/f064f7780ebd82e31929c68278f31645/recovered.edits/9.seqid 2023-07-14 05:13:30,504 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f064f7780ebd82e31929c68278f31645 2023-07-14 05:13:30,504 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-14 05:13:30,507 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:30,513 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-14 05:13:30,525 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-14 05:13:30,526 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:30,526 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-14 05:13:30,526 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689311590853.f064f7780ebd82e31929c68278f31645.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689311610526"}]},"ts":"9223372036854775807"} 2023-07-14 05:13:30,526 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689311590853.19ccb6e05b16484cd988b85623700843.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689311610526"}]},"ts":"9223372036854775807"} 2023-07-14 05:13:30,528 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-14 05:13:30,528 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f064f7780ebd82e31929c68278f31645, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689311590853.f064f7780ebd82e31929c68278f31645.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 19ccb6e05b16484cd988b85623700843, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689311590853.19ccb6e05b16484cd988b85623700843.', STARTKEY => '1', ENDKEY => ''}] 2023-07-14 05:13:30,528 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-14 05:13:30,529 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689311610529"}]},"ts":"9223372036854775807"} 2023-07-14 05:13:30,531 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-14 05:13:30,533 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:30,537 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 68 msec 2023-07-14 05:13:30,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-14 05:13:30,585 INFO [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-14 05:13:30,597 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-14 05:13:30,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:30,601 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-14 05:13:30,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 05:13:30,605 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-14 05:13:30,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 05:13:30,646 INFO [Listener at jenkins-hbase4.apache.org/38651] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=759 (was 747) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-839015254_17 at /127.0.0.1:53678 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-839015254_17 at /127.0.0.1:39298 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x11720e3f-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x11720e3f-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x11720e3f-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x11720e3f-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x11720e3f-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x11720e3f-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-120091560_1 at /127.0.0.1:54180 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3827 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-839015254_17 at /127.0.0.1:54200 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (145847449) connection to jenkins-hbase4.apache.org/172.31.14.131:38661 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-120091560_1 at /127.0.0.1:39280 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=905 (was 900) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=556 (was 382) - SystemLoadAverage LEAK? -, ProcessCount=187 (was 184) - ProcessCount LEAK? -, AvailableMemoryMB=3633 (was 4092) 2023-07-14 05:13:30,646 WARN [Listener at jenkins-hbase4.apache.org/38651] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-14 05:13:30,680 INFO [Listener at jenkins-hbase4.apache.org/38651] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=759, OpenFileDescriptor=905, MaxFileDescriptor=60000, SystemLoadAverage=556, ProcessCount=187, AvailableMemoryMB=3623 2023-07-14 05:13:30,680 WARN [Listener at jenkins-hbase4.apache.org/38651] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-14 05:13:30,683 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-14 05:13:30,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 05:13:30,687 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 05:13:30,688 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 05:13:30,688 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-14 05:13:30,691 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testEmptyExportFileSystemState/d04a1debc6321b9fb51750c1a106214f 2023-07-14 05:13:30,691 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testEmptyExportFileSystemState/6e74673533be698b8ca8e75c990604e4 2023-07-14 05:13:30,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-14 05:13:30,692 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testEmptyExportFileSystemState/d04a1debc6321b9fb51750c1a106214f empty. 2023-07-14 05:13:30,693 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testEmptyExportFileSystemState/6e74673533be698b8ca8e75c990604e4 empty. 2023-07-14 05:13:30,701 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testEmptyExportFileSystemState/d04a1debc6321b9fb51750c1a106214f 2023-07-14 05:13:30,703 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testEmptyExportFileSystemState/6e74673533be698b8ca8e75c990604e4 2023-07-14 05:13:30,703 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-14 05:13:30,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-14 05:13:30,795 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-14 05:13:30,807 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => d04a1debc6321b9fb51750c1a106214f, NAME => 'testtb-testEmptyExportFileSystemState,,1689311610682.d04a1debc6321b9fb51750c1a106214f.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp 2023-07-14 05:13:30,815 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 6e74673533be698b8ca8e75c990604e4, NAME => 'testtb-testEmptyExportFileSystemState,1,1689311610682.6e74673533be698b8ca8e75c990604e4.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp 2023-07-14 05:13:30,955 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689311610682.d04a1debc6321b9fb51750c1a106214f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 05:13:30,956 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing d04a1debc6321b9fb51750c1a106214f, disabling compactions & flushes 2023-07-14 05:13:30,956 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689311610682.d04a1debc6321b9fb51750c1a106214f. 2023-07-14 05:13:30,956 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689311610682.d04a1debc6321b9fb51750c1a106214f. 2023-07-14 05:13:30,956 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689311610682.d04a1debc6321b9fb51750c1a106214f. after waiting 0 ms 2023-07-14 05:13:30,956 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689311610682.d04a1debc6321b9fb51750c1a106214f. 2023-07-14 05:13:30,956 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689311610682.d04a1debc6321b9fb51750c1a106214f. 2023-07-14 05:13:30,956 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for d04a1debc6321b9fb51750c1a106214f: 2023-07-14 05:13:30,956 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689311610682.6e74673533be698b8ca8e75c990604e4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 05:13:30,956 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 6e74673533be698b8ca8e75c990604e4, disabling compactions & flushes 2023-07-14 05:13:30,957 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689311610682.6e74673533be698b8ca8e75c990604e4. 2023-07-14 05:13:30,957 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689311610682.6e74673533be698b8ca8e75c990604e4. 2023-07-14 05:13:30,957 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689311610682.6e74673533be698b8ca8e75c990604e4. after waiting 0 ms 2023-07-14 05:13:30,957 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689311610682.6e74673533be698b8ca8e75c990604e4. 2023-07-14 05:13:30,957 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689311610682.6e74673533be698b8ca8e75c990604e4. 2023-07-14 05:13:30,957 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 6e74673533be698b8ca8e75c990604e4: 2023-07-14 05:13:30,967 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 05:13:30,972 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689311610682.d04a1debc6321b9fb51750c1a106214f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689311610971"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689311610971"}]},"ts":"1689311610971"} 2023-07-14 05:13:30,972 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689311610682.6e74673533be698b8ca8e75c990604e4.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689311610971"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689311610971"}]},"ts":"1689311610971"} 2023-07-14 05:13:30,974 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 05:13:30,975 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 05:13:30,976 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689311610976"}]},"ts":"1689311610976"} 2023-07-14 05:13:30,977 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-14 05:13:30,982 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-14 05:13:30,983 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 05:13:30,983 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 05:13:30,983 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 05:13:30,983 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 05:13:30,984 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d04a1debc6321b9fb51750c1a106214f, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6e74673533be698b8ca8e75c990604e4, ASSIGN}] 2023-07-14 05:13:30,986 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6e74673533be698b8ca8e75c990604e4, ASSIGN 2023-07-14 05:13:30,987 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d04a1debc6321b9fb51750c1a106214f, ASSIGN 2023-07-14 05:13:30,993 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6e74673533be698b8ca8e75c990604e4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43331,1689311513888; forceNewPlan=false, retain=false 2023-07-14 05:13:30,994 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d04a1debc6321b9fb51750c1a106214f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35535,1689311513825; forceNewPlan=false, retain=false 2023-07-14 05:13:30,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-14 05:13:31,143 INFO [jenkins-hbase4:35845] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 05:13:31,152 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=6e74673533be698b8ca8e75c990604e4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:31,152 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689311610682.6e74673533be698b8ca8e75c990604e4.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689311611151"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689311611151"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689311611151"}]},"ts":"1689311611151"} 2023-07-14 05:13:31,152 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=d04a1debc6321b9fb51750c1a106214f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:31,152 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689311610682.d04a1debc6321b9fb51750c1a106214f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689311611152"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689311611152"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689311611152"}]},"ts":"1689311611152"} 2023-07-14 05:13:31,156 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure d04a1debc6321b9fb51750c1a106214f, server=jenkins-hbase4.apache.org,35535,1689311513825}] 2023-07-14 05:13:31,160 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure 6e74673533be698b8ca8e75c990604e4, server=jenkins-hbase4.apache.org,43331,1689311513888}] 2023-07-14 05:13:31,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-14 05:13:31,312 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689311610682.d04a1debc6321b9fb51750c1a106214f. 2023-07-14 05:13:31,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d04a1debc6321b9fb51750c1a106214f, NAME => 'testtb-testEmptyExportFileSystemState,,1689311610682.d04a1debc6321b9fb51750c1a106214f.', STARTKEY => '', ENDKEY => '1'} 2023-07-14 05:13:31,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689311610682.d04a1debc6321b9fb51750c1a106214f. service=AccessControlService 2023-07-14 05:13:31,313 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 05:13:31,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState d04a1debc6321b9fb51750c1a106214f 2023-07-14 05:13:31,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689311610682.d04a1debc6321b9fb51750c1a106214f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 05:13:31,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d04a1debc6321b9fb51750c1a106214f 2023-07-14 05:13:31,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d04a1debc6321b9fb51750c1a106214f 2023-07-14 05:13:31,317 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689311610682.6e74673533be698b8ca8e75c990604e4. 2023-07-14 05:13:31,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6e74673533be698b8ca8e75c990604e4, NAME => 'testtb-testEmptyExportFileSystemState,1,1689311610682.6e74673533be698b8ca8e75c990604e4.', STARTKEY => '1', ENDKEY => ''} 2023-07-14 05:13:31,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689311610682.6e74673533be698b8ca8e75c990604e4. service=AccessControlService 2023-07-14 05:13:31,317 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 05:13:31,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 6e74673533be698b8ca8e75c990604e4 2023-07-14 05:13:31,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689311610682.6e74673533be698b8ca8e75c990604e4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 05:13:31,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6e74673533be698b8ca8e75c990604e4 2023-07-14 05:13:31,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6e74673533be698b8ca8e75c990604e4 2023-07-14 05:13:31,320 INFO [StoreOpener-d04a1debc6321b9fb51750c1a106214f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d04a1debc6321b9fb51750c1a106214f 2023-07-14 05:13:31,323 INFO [StoreOpener-6e74673533be698b8ca8e75c990604e4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6e74673533be698b8ca8e75c990604e4 2023-07-14 05:13:31,325 DEBUG [StoreOpener-6e74673533be698b8ca8e75c990604e4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testEmptyExportFileSystemState/6e74673533be698b8ca8e75c990604e4/cf 2023-07-14 05:13:31,325 DEBUG [StoreOpener-6e74673533be698b8ca8e75c990604e4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testEmptyExportFileSystemState/6e74673533be698b8ca8e75c990604e4/cf 2023-07-14 05:13:31,325 INFO [StoreOpener-6e74673533be698b8ca8e75c990604e4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6e74673533be698b8ca8e75c990604e4 columnFamilyName cf 2023-07-14 05:13:31,326 INFO [StoreOpener-6e74673533be698b8ca8e75c990604e4-1] regionserver.HStore(310): Store=6e74673533be698b8ca8e75c990604e4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 05:13:31,327 DEBUG [StoreOpener-d04a1debc6321b9fb51750c1a106214f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testEmptyExportFileSystemState/d04a1debc6321b9fb51750c1a106214f/cf 2023-07-14 05:13:31,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testEmptyExportFileSystemState/6e74673533be698b8ca8e75c990604e4 2023-07-14 05:13:31,327 DEBUG [StoreOpener-d04a1debc6321b9fb51750c1a106214f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testEmptyExportFileSystemState/d04a1debc6321b9fb51750c1a106214f/cf 2023-07-14 05:13:31,327 INFO [StoreOpener-d04a1debc6321b9fb51750c1a106214f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d04a1debc6321b9fb51750c1a106214f columnFamilyName cf 2023-07-14 05:13:31,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testEmptyExportFileSystemState/6e74673533be698b8ca8e75c990604e4 2023-07-14 05:13:31,331 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6e74673533be698b8ca8e75c990604e4 2023-07-14 05:13:31,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testEmptyExportFileSystemState/6e74673533be698b8ca8e75c990604e4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 05:13:31,334 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6e74673533be698b8ca8e75c990604e4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61376373, jitterRate=-0.08542077243328094}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 05:13:31,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6e74673533be698b8ca8e75c990604e4: 2023-07-14 05:13:31,336 INFO [StoreOpener-d04a1debc6321b9fb51750c1a106214f-1] regionserver.HStore(310): Store=d04a1debc6321b9fb51750c1a106214f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 05:13:31,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testEmptyExportFileSystemState/d04a1debc6321b9fb51750c1a106214f 2023-07-14 05:13:31,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testEmptyExportFileSystemState/d04a1debc6321b9fb51750c1a106214f 2023-07-14 05:13:31,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d04a1debc6321b9fb51750c1a106214f 2023-07-14 05:13:31,343 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689311610682.6e74673533be698b8ca8e75c990604e4., pid=94, masterSystemTime=1689311611312 2023-07-14 05:13:31,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testEmptyExportFileSystemState/d04a1debc6321b9fb51750c1a106214f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 05:13:31,343 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d04a1debc6321b9fb51750c1a106214f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63120470, jitterRate=-0.05943170189857483}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 05:13:31,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d04a1debc6321b9fb51750c1a106214f: 2023-07-14 05:13:31,344 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689311610682.d04a1debc6321b9fb51750c1a106214f., pid=93, masterSystemTime=1689311611309 2023-07-14 05:13:31,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689311610682.6e74673533be698b8ca8e75c990604e4. 2023-07-14 05:13:31,344 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689311610682.6e74673533be698b8ca8e75c990604e4. 2023-07-14 05:13:31,345 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=6e74673533be698b8ca8e75c990604e4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:31,345 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689311610682.6e74673533be698b8ca8e75c990604e4.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689311611345"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689311611345"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689311611345"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689311611345"}]},"ts":"1689311611345"} 2023-07-14 05:13:31,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689311610682.d04a1debc6321b9fb51750c1a106214f. 2023-07-14 05:13:31,346 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689311610682.d04a1debc6321b9fb51750c1a106214f. 2023-07-14 05:13:31,346 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=d04a1debc6321b9fb51750c1a106214f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:31,346 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689311610682.d04a1debc6321b9fb51750c1a106214f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689311611346"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689311611346"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689311611346"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689311611346"}]},"ts":"1689311611346"} 2023-07-14 05:13:31,349 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-14 05:13:31,349 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure 6e74673533be698b8ca8e75c990604e4, server=jenkins-hbase4.apache.org,43331,1689311513888 in 187 msec 2023-07-14 05:13:31,351 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6e74673533be698b8ca8e75c990604e4, ASSIGN in 365 msec 2023-07-14 05:13:31,358 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-14 05:13:31,358 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure d04a1debc6321b9fb51750c1a106214f, server=jenkins-hbase4.apache.org,35535,1689311513825 in 199 msec 2023-07-14 05:13:31,360 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=90 2023-07-14 05:13:31,360 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d04a1debc6321b9fb51750c1a106214f, ASSIGN in 374 msec 2023-07-14 05:13:31,362 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 05:13:31,363 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689311611362"}]},"ts":"1689311611362"} 2023-07-14 05:13:31,367 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-14 05:13:31,369 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 05:13:31,370 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-14 05:13:31,378 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35487] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-14 05:13:31,379 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 05:13:31,379 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 05:13:31,380 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 05:13:31,380 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 05:13:31,381 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 05:13:31,381 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 05:13:31,382 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 05:13:31,382 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 05:13:31,385 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 700 msec 2023-07-14 05:13:31,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-14 05:13:31,799 INFO [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-14 05:13:31,799 DEBUG [Listener at jenkins-hbase4.apache.org/38651] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testEmptyExportFileSystemState get assigned. Timeout = 60000ms 2023-07-14 05:13:31,799 INFO [Listener at jenkins-hbase4.apache.org/38651] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 05:13:31,805 INFO [Listener at jenkins-hbase4.apache.org/38651] hbase.HBaseTestingUtility(3484): All regions for table testtb-testEmptyExportFileSystemState assigned to meta. Checking AM states. 2023-07-14 05:13:31,805 INFO [Listener at jenkins-hbase4.apache.org/38651] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 05:13:31,806 INFO [Listener at jenkins-hbase4.apache.org/38651] hbase.HBaseTestingUtility(3504): All regions for table testtb-testEmptyExportFileSystemState assigned. 2023-07-14 05:13:31,818 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 05:13:31,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689311611818 (current time:1689311611818). 2023-07-14 05:13:31,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 05:13:31,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] zookeeper.ReadOnlyZKClient(139): Connect 0x6727440b to 127.0.0.1:55310 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 05:13:31,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18c6ff42, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 05:13:31,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 05:13:31,874 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49742, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 05:13:31,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6727440b to 127.0.0.1:55310 2023-07-14 05:13:31,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 05:13:31,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] zookeeper.ReadOnlyZKClient(139): Connect 0x47b12309 to 127.0.0.1:55310 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 05:13:31,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1aeb30e8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 05:13:31,935 DEBUG [hconnection-0x35f8e018-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 05:13:31,936 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49744, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 05:13:31,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 05:13:31,944 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40088, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 05:13:31,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x47b12309 to 127.0.0.1:55310 2023-07-14 05:13:31,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 05:13:31,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-14 05:13:31,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 05:13:31,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 05:13:31,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-14 05:13:31,965 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-14 05:13:31,967 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689312211967 2023-07-14 05:13:31,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 05:13:31,967 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-14 05:13:31,967 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 05:13:31,968 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 05:13:31,972 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-14 05:13:31,972 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-14 05:13:31,973 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 10 msec 2023-07-14 05:13:31,980 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-14 05:13:31,981 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689312211981 2023-07-14 05:13:32,038 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,039 INFO [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-14 05:13:32,039 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 05:13:32,041 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-14 05:13:32,041 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-14 05:13:32,068 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 05:13:32,069 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,069 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 05:13:32,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 05:13:32,070 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 05:13:32,073 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:13:32,074 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:32,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:13:32,074 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:13:32,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:13:32,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:13:32,074 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:13:32,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:13:32,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:13:32,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:13:32,074 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:32,074 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:32,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,075 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,075 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:32,075 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 05:13:32,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-14 05:13:32,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,076 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-14 05:13:32,076 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-14 05:13:32,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,077 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-14 05:13:32,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,079 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-14 05:13:32,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,080 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-14 05:13:32,084 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,085 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-14 05:13:32,085 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 05:13:32,085 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,085 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-14 05:13:32,088 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-14 05:13:32,088 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-14 05:13:32,085 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,088 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35535,1689311513825' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-14 05:13:32,088 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-14 05:13:32,088 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 05:13:32,088 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 05:13:32,090 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-14 05:13:32,091 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-14 05:13:32,091 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-14 05:13:32,091 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-14 05:13:32,091 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35487,1689311513755' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-14 05:13:32,091 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43331,1689311513888' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-14 05:13:32,094 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,094 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:32,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:32,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:13:32,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:13:32,094 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:32,094 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,094 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,095 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:13:32,095 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 05:13:32,095 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,095 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,095 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 05:13:32,095 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 05:13:32,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:13:32,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:32,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:32,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:32,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:13:32,097 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35535,1689311513825' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-14 05:13:32,097 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d842b9a[Count = 1] remaining members to acquire global barrier 2023-07-14 05:13:32,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:32,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:13:32,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:13:32,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:13:32,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:13:32,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:32,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:32,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:32,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:13:32,100 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43331,1689311513888' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-14 05:13:32,100 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d842b9a[Count = 0] remaining members to acquire global barrier 2023-07-14 05:13:32,100 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-14 05:13:32,100 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,101 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,102 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-14 05:13:32,102 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-14 05:13:32,102 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35487,1689311513755' in zk 2023-07-14 05:13:32,102 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,102 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,102 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-14 05:13:32,102 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-14 05:13:32,103 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:32,104 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-14 05:13:32,104 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 05:13:32,104 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-14 05:13:32,105 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:32,105 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 05:13:32,108 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 05:13:32,108 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 05:13:32,108 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689311610682.d04a1debc6321b9fb51750c1a106214f. 2023-07-14 05:13:32,108 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689311610682.6e74673533be698b8ca8e75c990604e4. 2023-07-14 05:13:32,108 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689311610682.d04a1debc6321b9fb51750c1a106214f. started... 2023-07-14 05:13:32,108 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 05:13:32,109 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 05:13:32,108 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689311610682.6e74673533be698b8ca8e75c990604e4. started... 2023-07-14 05:13:32,110 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d04a1debc6321b9fb51750c1a106214f: 2023-07-14 05:13:32,114 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6e74673533be698b8ca8e75c990604e4: 2023-07-14 05:13:32,114 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689311610682.6e74673533be698b8ca8e75c990604e4.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,114 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 05:13:32,114 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689311610682.d04a1debc6321b9fb51750c1a106214f.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,114 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 05:13:32,114 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 05:13:32,117 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 05:13:32,149 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689311610682.6e74673533be698b8ca8e75c990604e4. completed. 2023-07-14 05:13:32,150 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689311610682.6e74673533be698b8ca8e75c990604e4. 2023-07-14 05:13:32,150 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 05:13:32,150 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 05:13:32,150 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:32,150 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-14 05:13:32,150 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43331,1689311513888' in zk 2023-07-14 05:13:32,153 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-14 05:13:32,153 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:32,153 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 05:13:32,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:32,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:13:32,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:13:32,153 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-14 05:13:32,156 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689311610682.d04a1debc6321b9fb51750c1a106214f. completed. 2023-07-14 05:13:32,156 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689311610682.d04a1debc6321b9fb51750c1a106214f. 2023-07-14 05:13:32,156 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 05:13:32,156 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 05:13:32,156 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:32,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:13:32,156 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-14 05:13:32,156 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35535,1689311513825' in zk 2023-07-14 05:13:32,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:13:32,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:32,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:32,163 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-14 05:13:32,163 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 05:13:32,163 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-14 05:13:32,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:32,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:13:32,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:32,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:32,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:32,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,43331,1689311513888': 2023-07-14 05:13:32,168 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43331,1689311513888' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-14 05:13:32,170 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:32,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:32,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:13:32,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:13:32,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:13:32,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:13:32,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:32,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:32,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:32,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:13:32,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:32,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:32,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:32,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,35535,1689311513825': 2023-07-14 05:13:32,175 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35535,1689311513825' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-14 05:13:32,175 INFO [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-14 05:13:32,175 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 05:13:32,175 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 05:13:32,175 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,175 INFO [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 05:13:32,177 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,177 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,177 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,178 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:13:32,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,177 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,178 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:13:32,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:13:32,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:13:32,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:13:32,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:13:32,177 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:13:32,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:13:32,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:13:32,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:13:32,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:13:32,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:13:32,179 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:32,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,180 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:32,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:13:32,182 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:32,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:32,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:32,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:32,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:13:32,185 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:32,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,185 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:32,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:32,186 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:32,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:32,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:32,189 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:13:32,189 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:32,189 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,189 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:32,189 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:13:32,189 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 05:13:32,189 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:13:32,189 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,189 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:32,191 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,189 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:13:32,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:13:32,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:13:32,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:13:32,191 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:13:32,191 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,191 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:32,191 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:13:32,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:13:32,191 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:13:32,191 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:32,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:13:32,191 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:32,191 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,191 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:13:32,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:13:32,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:13:32,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:13:32,192 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:13:32,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:13:32,219 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,250 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-14 05:13:32,250 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,251 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,251 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689311611967Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689311612191 (+224 ms)Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689311612191Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689311612196 (+5 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689311612211 (+15 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689311612250 (+39 ms) 2023-07-14 05:13:32,255 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-14 05:13:32,258 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 285 msec 2023-07-14 05:13:32,270 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 05:13:32,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 05:13:32,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 05:13:32,278 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35535] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689311610682.d04a1debc6321b9fb51750c1a106214f. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 05:13:32,280 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43331] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689311610682.6e74673533be698b8ca8e75c990604e4. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 05:13:32,284 DEBUG [Listener at jenkins-hbase4.apache.org/38651] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-14 05:13:32,285 DEBUG [Listener at jenkins-hbase4.apache.org/38651] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689311610682.d04a1debc6321b9fb51750c1a106214f. 2023-07-14 05:13:32,285 INFO [Listener at jenkins-hbase4.apache.org/38651] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 05:13:32,327 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 05:13:32,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689311612327 (current time:1689311612327). 2023-07-14 05:13:32,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 05:13:32,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] zookeeper.ReadOnlyZKClient(139): Connect 0x7f65da55 to 127.0.0.1:55310 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 05:13:32,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d6f0d81, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 05:13:32,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 05:13:32,344 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49746, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 05:13:32,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7f65da55 to 127.0.0.1:55310 2023-07-14 05:13:32,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 05:13:32,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] zookeeper.ReadOnlyZKClient(139): Connect 0x7d197c09 to 127.0.0.1:55310 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 05:13:32,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2cffb68d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 05:13:32,355 DEBUG [hconnection-0x5909b596-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 05:13:32,362 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49762, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 05:13:32,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 05:13:32,367 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40090, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 05:13:32,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7d197c09 to 127.0.0.1:55310 2023-07-14 05:13:32,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 05:13:32,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-14 05:13:32,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 05:13:32,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 05:13:32,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-14 05:13:32,372 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-14 05:13:32,374 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689312212374 2023-07-14 05:13:32,374 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-14 05:13:32,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 05:13:32,374 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 05:13:32,374 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 05:13:32,376 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-14 05:13:32,381 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-14 05:13:32,382 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-14 05:13:32,382 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 10 msec 2023-07-14 05:13:32,383 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-14 05:13:32,384 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689312212384 2023-07-14 05:13:32,409 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,410 INFO [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-14 05:13:32,410 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 05:13:32,411 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-14 05:13:32,411 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-14 05:13:32,412 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,412 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,413 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:13:32,413 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:13:32,413 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:32,413 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:13:32,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:13:32,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:13:32,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:13:32,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:13:32,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:13:32,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:13:32,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,414 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:32,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,414 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:32,414 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,415 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,415 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-14 05:13:32,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,415 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:32,415 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 05:13:32,415 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-14 05:13:32,415 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,415 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-14 05:13:32,415 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 05:13:32,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-14 05:13:32,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-14 05:13:32,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,416 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-14 05:13:32,416 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-14 05:13:32,421 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,426 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,426 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-14 05:13:32,426 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 05:13:32,423 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-14 05:13:32,426 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-14 05:13:32,428 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-14 05:13:32,428 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-14 05:13:32,427 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-14 05:13:32,428 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35535,1689311513825' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-14 05:13:32,428 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 05:13:32,428 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35487,1689311513755' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-14 05:13:32,432 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-14 05:13:32,432 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-14 05:13:32,432 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43331,1689311513888' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-14 05:13:32,433 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:32,433 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:32,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:13:32,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:13:32,434 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,434 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,435 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,435 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 05:13:32,435 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,435 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 05:13:32,439 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,439 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 05:13:32,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:13:32,439 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:32,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:13:32,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:32,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:32,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:32,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:13:32,442 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35535,1689311513825' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-14 05:13:32,442 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@35bc2e1c[Count = 1] remaining members to acquire global barrier 2023-07-14 05:13:32,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:32,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:13:32,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:13:32,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:13:32,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:13:32,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:32,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:32,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:32,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:13:32,444 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43331,1689311513888' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-14 05:13:32,444 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@35bc2e1c[Count = 0] remaining members to acquire global barrier 2023-07-14 05:13:32,444 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-14 05:13:32,444 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,451 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,451 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,451 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,452 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-14 05:13:32,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,452 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:32,452 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-14 05:13:32,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,452 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-14 05:13:32,452 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 05:13:32,452 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 05:13:32,452 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-14 05:13:32,452 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:32,452 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689311610682.d04a1debc6321b9fb51750c1a106214f. 2023-07-14 05:13:32,452 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 05:13:32,452 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689311610682.d04a1debc6321b9fb51750c1a106214f. started... 2023-07-14 05:13:32,452 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689311610682.6e74673533be698b8ca8e75c990604e4. 2023-07-14 05:13:32,452 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35487,1689311513755' in zk 2023-07-14 05:13:32,452 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 05:13:32,452 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 05:13:32,452 INFO [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d04a1debc6321b9fb51750c1a106214f 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-14 05:13:32,452 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689311610682.6e74673533be698b8ca8e75c990604e4. started... 2023-07-14 05:13:32,453 INFO [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6e74673533be698b8ca8e75c990604e4 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-14 05:13:32,454 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-14 05:13:32,454 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 05:13:32,454 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-14 05:13:32,474 INFO [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testEmptyExportFileSystemState/6e74673533be698b8ca8e75c990604e4/.tmp/cf/ac96c8f9d7974ff1992c46a48e3a17c8 2023-07-14 05:13:32,474 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 05:13:32,475 INFO [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testEmptyExportFileSystemState/d04a1debc6321b9fb51750c1a106214f/.tmp/cf/42c7a970155c43f390dc5de76f960603 2023-07-14 05:13:32,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 05:13:32,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 05:13:32,476 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 05:13:32,485 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testEmptyExportFileSystemState/6e74673533be698b8ca8e75c990604e4/.tmp/cf/ac96c8f9d7974ff1992c46a48e3a17c8 as hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testEmptyExportFileSystemState/6e74673533be698b8ca8e75c990604e4/cf/ac96c8f9d7974ff1992c46a48e3a17c8 2023-07-14 05:13:32,491 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testEmptyExportFileSystemState/d04a1debc6321b9fb51750c1a106214f/.tmp/cf/42c7a970155c43f390dc5de76f960603 as hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testEmptyExportFileSystemState/d04a1debc6321b9fb51750c1a106214f/cf/42c7a970155c43f390dc5de76f960603 2023-07-14 05:13:32,492 INFO [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testEmptyExportFileSystemState/6e74673533be698b8ca8e75c990604e4/cf/ac96c8f9d7974ff1992c46a48e3a17c8, entries=48, sequenceid=6, filesize=8.1 K 2023-07-14 05:13:32,493 INFO [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 6e74673533be698b8ca8e75c990604e4 in 41ms, sequenceid=6, compaction requested=false 2023-07-14 05:13:32,495 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6e74673533be698b8ca8e75c990604e4: 2023-07-14 05:13:32,495 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689311610682.6e74673533be698b8ca8e75c990604e4.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,497 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 05:13:32,497 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testEmptyExportFileSystemState/6e74673533be698b8ca8e75c990604e4/cf/ac96c8f9d7974ff1992c46a48e3a17c8] hfiles 2023-07-14 05:13:32,497 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testEmptyExportFileSystemState/6e74673533be698b8ca8e75c990604e4/cf/ac96c8f9d7974ff1992c46a48e3a17c8 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,505 INFO [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testEmptyExportFileSystemState/d04a1debc6321b9fb51750c1a106214f/cf/42c7a970155c43f390dc5de76f960603, entries=2, sequenceid=6, filesize=5.0 K 2023-07-14 05:13:32,506 INFO [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for d04a1debc6321b9fb51750c1a106214f in 54ms, sequenceid=6, compaction requested=false 2023-07-14 05:13:32,506 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d04a1debc6321b9fb51750c1a106214f: 2023-07-14 05:13:32,506 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689311610682.d04a1debc6321b9fb51750c1a106214f.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,506 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 05:13:32,506 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testEmptyExportFileSystemState/d04a1debc6321b9fb51750c1a106214f/cf/42c7a970155c43f390dc5de76f960603] hfiles 2023-07-14 05:13:32,506 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testEmptyExportFileSystemState/d04a1debc6321b9fb51750c1a106214f/cf/42c7a970155c43f390dc5de76f960603 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,524 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689311610682.6e74673533be698b8ca8e75c990604e4. completed. 2023-07-14 05:13:32,524 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689311610682.6e74673533be698b8ca8e75c990604e4. 2023-07-14 05:13:32,524 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 05:13:32,524 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 05:13:32,524 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:32,534 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-14 05:13:32,534 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43331,1689311513888' in zk 2023-07-14 05:13:32,536 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-14 05:13:32,536 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:32,536 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 05:13:32,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:32,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:13:32,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:13:32,536 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-14 05:13:32,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:13:32,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:13:32,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:32,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:32,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:32,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:13:32,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:32,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:32,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,43331,1689311513888': 2023-07-14 05:13:32,545 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43331,1689311513888' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-14 05:13:32,548 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689311610682.d04a1debc6321b9fb51750c1a106214f. completed. 2023-07-14 05:13:32,548 DEBUG [rs(jenkins-hbase4.apache.org,35535,1689311513825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689311610682.d04a1debc6321b9fb51750c1a106214f. 2023-07-14 05:13:32,548 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 05:13:32,548 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 05:13:32,548 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:32,548 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-14 05:13:32,548 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35535,1689311513825' in zk 2023-07-14 05:13:32,554 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-14 05:13:32,554 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:32,554 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 05:13:32,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:32,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:13:32,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:13:32,554 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-14 05:13:32,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:13:32,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:13:32,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:32,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:32,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:32,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:13:32,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:32,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:32,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:32,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,35535,1689311513825': 2023-07-14 05:13:32,559 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35535,1689311513825' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-14 05:13:32,559 INFO [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-14 05:13:32,560 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 05:13:32,560 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 05:13:32,560 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,560 INFO [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 05:13:32,562 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,562 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,562 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:13:32,562 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,562 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:13:32,562 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:13:32,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:13:32,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:13:32,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,562 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:13:32,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:13:32,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:13:32,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:13:32,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:13:32,563 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:32,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:13:32,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:13:32,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,563 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:32,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,564 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:32,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:13:32,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:32,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:32,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:32,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:13:32,565 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:32,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,566 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:32,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:32,566 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:32,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:32,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:32,568 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:32,568 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,568 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:32,568 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:13:32,568 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:13:32,568 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:13:32,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:13:32,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:13:32,569 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:13:32,568 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:32,569 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,569 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 05:13:32,569 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:13:32,569 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:13:32,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:13:32,569 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:13:32,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:13:32,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:13:32,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:13:32,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:13:32,569 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,571 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:32,571 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,571 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:32,571 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:32,571 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,571 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:13:32,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:13:32,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:13:32,571 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:13:32,589 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,607 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-14 05:13:32,607 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,607 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,607 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689311612374Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689311612569 (+195 ms)Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689311612569Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689311612574 (+5 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689311612582 (+8 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689311612607 (+25 ms) 2023-07-14 05:13:32,610 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-14 05:13:32,611 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 230 msec 2023-07-14 05:13:32,676 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 05:13:32,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 05:13:32,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 05:13:32,678 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/export-test/export-1689311612678 2023-07-14 05:13:32,678 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36535, tgtDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/export-test/export-1689311612678, rawTgtDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/export-test/export-1689311612678, srcFsUri=hdfs://localhost:36535, srcDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48 2023-07-14 05:13:32,703 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36535, inputRoot=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48 2023-07-14 05:13:32,703 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_198224791_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/export-test/export-1689311612678, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/export-test/export-1689311612678/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,703 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36535, inputRoot=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48, snapshotDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-14 05:13:32,711 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/export-test/export-1689311612678/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:32,766 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 05:13:32,766 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 05:13:32,766 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 05:13:32,767 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 05:13:32,767 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-14 05:13:32,767 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 05:13:32,767 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 05:13:32,849 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/hadoop-6973843201548509721.jar 2023-07-14 05:13:32,849 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 05:13:32,850 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 05:13:32,850 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 05:13:32,850 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 05:13:32,851 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 05:13:32,851 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 05:13:32,851 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 05:13:32,852 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 05:13:32,852 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 05:13:32,852 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 05:13:32,852 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 05:13:32,853 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 05:13:32,853 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 05:13:32,853 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 05:13:32,854 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 05:13:32,854 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 05:13:32,855 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 05:13:32,855 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 05:13:32,855 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 05:13:32,855 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 05:13:32,856 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 05:13:32,856 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 05:13:32,856 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 05:13:33,587 WARN [Listener at jenkins-hbase4.apache.org/38651] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 05:13:33,591 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-14 05:13:34,252 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 05:13:34,252 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 05:13:34,256 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689311521774_0005_000001 (auth:SIMPLE) 2023-07-14 05:13:34,715 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689311521774_0006_000001 (auth:SIMPLE) 2023-07-14 05:13:35,336 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 05:13:40,365 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689311521774_0006_000001 (auth:SIMPLE) 2023-07-14 05:13:42,852 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 05:13:42,854 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 05:13:42,879 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:42,879 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 05:13:42,879 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 05:13:42,880 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-839015254_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:42,880 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(367): hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-14 05:13:42,880 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(367): hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-14 05:13:42,880 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-839015254_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/export-test/export-1689311612678/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/export-test/export-1689311612678/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:42,881 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(367): hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/export-test/export-1689311612678/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-14 05:13:42,881 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(367): hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/export-test/export-1689311612678/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-14 05:13:42,892 INFO [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-14 05:13:42,892 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-14 05:13:42,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 05:13:42,899 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689311622899"}]},"ts":"1689311622899"} 2023-07-14 05:13:42,901 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-14 05:13:42,903 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-14 05:13:42,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-14 05:13:42,905 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d04a1debc6321b9fb51750c1a106214f, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6e74673533be698b8ca8e75c990604e4, UNASSIGN}] 2023-07-14 05:13:42,914 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d04a1debc6321b9fb51750c1a106214f, UNASSIGN 2023-07-14 05:13:42,914 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6e74673533be698b8ca8e75c990604e4, UNASSIGN 2023-07-14 05:13:42,915 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=d04a1debc6321b9fb51750c1a106214f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:42,915 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689311610682.d04a1debc6321b9fb51750c1a106214f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689311622915"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689311622915"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689311622915"}]},"ts":"1689311622915"} 2023-07-14 05:13:42,916 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=6e74673533be698b8ca8e75c990604e4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:42,916 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689311610682.6e74673533be698b8ca8e75c990604e4.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689311622916"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689311622916"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689311622916"}]},"ts":"1689311622916"} 2023-07-14 05:13:42,918 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure d04a1debc6321b9fb51750c1a106214f, server=jenkins-hbase4.apache.org,35535,1689311513825}] 2023-07-14 05:13:42,922 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 6e74673533be698b8ca8e75c990604e4, server=jenkins-hbase4.apache.org,43331,1689311513888}] 2023-07-14 05:13:43,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-14 05:13:43,073 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d04a1debc6321b9fb51750c1a106214f 2023-07-14 05:13:43,073 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d04a1debc6321b9fb51750c1a106214f, disabling compactions & flushes 2023-07-14 05:13:43,073 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689311610682.d04a1debc6321b9fb51750c1a106214f. 2023-07-14 05:13:43,074 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689311610682.d04a1debc6321b9fb51750c1a106214f. 2023-07-14 05:13:43,074 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689311610682.d04a1debc6321b9fb51750c1a106214f. after waiting 0 ms 2023-07-14 05:13:43,074 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689311610682.d04a1debc6321b9fb51750c1a106214f. 2023-07-14 05:13:43,074 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6e74673533be698b8ca8e75c990604e4 2023-07-14 05:13:43,075 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6e74673533be698b8ca8e75c990604e4, disabling compactions & flushes 2023-07-14 05:13:43,075 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689311610682.6e74673533be698b8ca8e75c990604e4. 2023-07-14 05:13:43,075 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689311610682.6e74673533be698b8ca8e75c990604e4. 2023-07-14 05:13:43,075 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689311610682.6e74673533be698b8ca8e75c990604e4. after waiting 0 ms 2023-07-14 05:13:43,075 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689311610682.6e74673533be698b8ca8e75c990604e4. 2023-07-14 05:13:43,121 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testEmptyExportFileSystemState/d04a1debc6321b9fb51750c1a106214f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 05:13:43,121 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 05:13:43,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testEmptyExportFileSystemState/6e74673533be698b8ca8e75c990604e4/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 05:13:43,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 05:13:43,123 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689311610682.d04a1debc6321b9fb51750c1a106214f. 2023-07-14 05:13:43,123 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689311610682.6e74673533be698b8ca8e75c990604e4. 2023-07-14 05:13:43,123 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d04a1debc6321b9fb51750c1a106214f: 2023-07-14 05:13:43,123 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6e74673533be698b8ca8e75c990604e4: 2023-07-14 05:13:43,130 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d04a1debc6321b9fb51750c1a106214f 2023-07-14 05:13:43,130 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=d04a1debc6321b9fb51750c1a106214f, regionState=CLOSED 2023-07-14 05:13:43,131 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689311610682.d04a1debc6321b9fb51750c1a106214f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689311623130"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689311623130"}]},"ts":"1689311623130"} 2023-07-14 05:13:43,131 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6e74673533be698b8ca8e75c990604e4 2023-07-14 05:13:43,131 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=6e74673533be698b8ca8e75c990604e4, regionState=CLOSED 2023-07-14 05:13:43,131 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689311610682.6e74673533be698b8ca8e75c990604e4.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689311623131"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689311623131"}]},"ts":"1689311623131"} 2023-07-14 05:13:43,135 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-14 05:13:43,135 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure d04a1debc6321b9fb51750c1a106214f, server=jenkins-hbase4.apache.org,35535,1689311513825 in 216 msec 2023-07-14 05:13:43,136 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-14 05:13:43,136 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 6e74673533be698b8ca8e75c990604e4, server=jenkins-hbase4.apache.org,43331,1689311513888 in 212 msec 2023-07-14 05:13:43,137 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d04a1debc6321b9fb51750c1a106214f, UNASSIGN in 230 msec 2023-07-14 05:13:43,138 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-14 05:13:43,138 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6e74673533be698b8ca8e75c990604e4, UNASSIGN in 231 msec 2023-07-14 05:13:43,139 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689311623139"}]},"ts":"1689311623139"} 2023-07-14 05:13:43,140 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-14 05:13:43,142 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-14 05:13:43,201 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 250 msec 2023-07-14 05:13:43,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-14 05:13:43,207 INFO [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-14 05:13:43,209 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-14 05:13:43,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 05:13:43,214 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 05:13:43,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-14 05:13:43,215 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 05:13:43,220 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35487] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-14 05:13:43,223 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 05:13:43,223 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 05:13:43,223 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 05:13:43,224 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 05:13:43,224 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testEmptyExportFileSystemState/6e74673533be698b8ca8e75c990604e4 2023-07-14 05:13:43,224 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testEmptyExportFileSystemState/d04a1debc6321b9fb51750c1a106214f 2023-07-14 05:13:43,225 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-14 05:13:43,225 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-14 05:13:43,225 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-14 05:13:43,225 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-14 05:13:43,228 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 05:13:43,228 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 05:13:43,228 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 05:13:43,228 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 05:13:43,228 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 05:13:43,228 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 05:13:43,229 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 05:13:43,229 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 05:13:43,230 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testEmptyExportFileSystemState/6e74673533be698b8ca8e75c990604e4/cf, FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testEmptyExportFileSystemState/6e74673533be698b8ca8e75c990604e4/recovered.edits] 2023-07-14 05:13:43,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-14 05:13:43,238 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testEmptyExportFileSystemState/d04a1debc6321b9fb51750c1a106214f/cf, FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testEmptyExportFileSystemState/d04a1debc6321b9fb51750c1a106214f/recovered.edits] 2023-07-14 05:13:43,252 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testEmptyExportFileSystemState/6e74673533be698b8ca8e75c990604e4/cf/ac96c8f9d7974ff1992c46a48e3a17c8 to hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/archive/data/default/testtb-testEmptyExportFileSystemState/6e74673533be698b8ca8e75c990604e4/cf/ac96c8f9d7974ff1992c46a48e3a17c8 2023-07-14 05:13:43,257 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testEmptyExportFileSystemState/d04a1debc6321b9fb51750c1a106214f/cf/42c7a970155c43f390dc5de76f960603 to hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/archive/data/default/testtb-testEmptyExportFileSystemState/d04a1debc6321b9fb51750c1a106214f/cf/42c7a970155c43f390dc5de76f960603 2023-07-14 05:13:43,263 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testEmptyExportFileSystemState/6e74673533be698b8ca8e75c990604e4/recovered.edits/9.seqid to hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/archive/data/default/testtb-testEmptyExportFileSystemState/6e74673533be698b8ca8e75c990604e4/recovered.edits/9.seqid 2023-07-14 05:13:43,265 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testEmptyExportFileSystemState/6e74673533be698b8ca8e75c990604e4 2023-07-14 05:13:43,265 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testEmptyExportFileSystemState/d04a1debc6321b9fb51750c1a106214f/recovered.edits/9.seqid to hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/archive/data/default/testtb-testEmptyExportFileSystemState/d04a1debc6321b9fb51750c1a106214f/recovered.edits/9.seqid 2023-07-14 05:13:43,266 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testEmptyExportFileSystemState/d04a1debc6321b9fb51750c1a106214f 2023-07-14 05:13:43,266 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-14 05:13:43,269 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 05:13:43,273 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-14 05:13:43,285 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-14 05:13:43,287 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 05:13:43,287 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-14 05:13:43,287 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689311610682.d04a1debc6321b9fb51750c1a106214f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689311623287"}]},"ts":"9223372036854775807"} 2023-07-14 05:13:43,287 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689311610682.6e74673533be698b8ca8e75c990604e4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689311623287"}]},"ts":"9223372036854775807"} 2023-07-14 05:13:43,290 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-14 05:13:43,290 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d04a1debc6321b9fb51750c1a106214f, NAME => 'testtb-testEmptyExportFileSystemState,,1689311610682.d04a1debc6321b9fb51750c1a106214f.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 6e74673533be698b8ca8e75c990604e4, NAME => 'testtb-testEmptyExportFileSystemState,1,1689311610682.6e74673533be698b8ca8e75c990604e4.', STARTKEY => '1', ENDKEY => ''}] 2023-07-14 05:13:43,290 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-14 05:13:43,290 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689311623290"}]},"ts":"9223372036854775807"} 2023-07-14 05:13:43,291 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-14 05:13:43,294 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 05:13:43,295 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 85 msec 2023-07-14 05:13:43,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-14 05:13:43,332 INFO [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-14 05:13:43,348 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-14 05:13:43,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:43,352 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-14 05:13:43,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-14 05:13:43,395 INFO [Listener at jenkins-hbase4.apache.org/38651] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=763 (was 759) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (145847449) connection to jenkins-hbase4.apache.org/172.31.14.131:37723 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x11720e3f-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (145847449) connection to jenkins-hbase4.apache.org/172.31.14.131:34381 from appattempt_1689311521774_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-839015254_17 at /127.0.0.1:38012 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x11720e3f-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x11720e3f-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (145847449) connection to jenkins-hbase4.apache.org/172.31.14.131:45913 from appattempt_1689311521774_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_336959161_1 at /127.0.0.1:35000 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-839015254_17 at /127.0.0.1:35032 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_336959161_1 at /127.0.0.1:43190 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x11720e3f-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-839015254_17 at /127.0.0.1:43200 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4478 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) - Thread LEAK? -, OpenFileDescriptor=925 (was 905) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=640 (was 556) - SystemLoadAverage LEAK? -, ProcessCount=184 (was 187), AvailableMemoryMB=3015 (was 3623) 2023-07-14 05:13:43,395 WARN [Listener at jenkins-hbase4.apache.org/38651] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-14 05:13:43,448 INFO [Listener at jenkins-hbase4.apache.org/38651] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=763, OpenFileDescriptor=925, MaxFileDescriptor=60000, SystemLoadAverage=640, ProcessCount=184, AvailableMemoryMB=3012 2023-07-14 05:13:43,448 WARN [Listener at jenkins-hbase4.apache.org/38651] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-14 05:13:43,451 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-14 05:13:43,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:43,457 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 05:13:43,457 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-14 05:13:43,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-14 05:13:43,459 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 05:13:43,461 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7c02b4f4e1320b7aba814144ec56468e 2023-07-14 05:13:43,461 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f90e4f504d13d8a2740fc852cad77ca0 2023-07-14 05:13:43,461 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f90e4f504d13d8a2740fc852cad77ca0 empty. 2023-07-14 05:13:43,461 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7c02b4f4e1320b7aba814144ec56468e empty. 2023-07-14 05:13:43,463 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f90e4f504d13d8a2740fc852cad77ca0 2023-07-14 05:13:43,463 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7c02b4f4e1320b7aba814144ec56468e 2023-07-14 05:13:43,463 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-14 05:13:43,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-14 05:13:43,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-14 05:13:43,921 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-14 05:13:43,932 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7c02b4f4e1320b7aba814144ec56468e, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689311623451.7c02b4f4e1320b7aba814144ec56468e.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp 2023-07-14 05:13:43,940 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => f90e4f504d13d8a2740fc852cad77ca0, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689311623451.f90e4f504d13d8a2740fc852cad77ca0.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp 2023-07-14 05:13:44,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-14 05:13:44,123 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689311623451.7c02b4f4e1320b7aba814144ec56468e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 05:13:44,123 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 7c02b4f4e1320b7aba814144ec56468e, disabling compactions & flushes 2023-07-14 05:13:44,123 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689311623451.7c02b4f4e1320b7aba814144ec56468e. 2023-07-14 05:13:44,123 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689311623451.7c02b4f4e1320b7aba814144ec56468e. 2023-07-14 05:13:44,123 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689311623451.7c02b4f4e1320b7aba814144ec56468e. after waiting 0 ms 2023-07-14 05:13:44,123 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689311623451.7c02b4f4e1320b7aba814144ec56468e. 2023-07-14 05:13:44,124 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689311623451.7c02b4f4e1320b7aba814144ec56468e. 2023-07-14 05:13:44,124 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 7c02b4f4e1320b7aba814144ec56468e: 2023-07-14 05:13:44,125 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689311623451.f90e4f504d13d8a2740fc852cad77ca0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 05:13:44,125 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing f90e4f504d13d8a2740fc852cad77ca0, disabling compactions & flushes 2023-07-14 05:13:44,125 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689311623451.f90e4f504d13d8a2740fc852cad77ca0. 2023-07-14 05:13:44,125 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689311623451.f90e4f504d13d8a2740fc852cad77ca0. 2023-07-14 05:13:44,126 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689311623451.f90e4f504d13d8a2740fc852cad77ca0. after waiting 0 ms 2023-07-14 05:13:44,126 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689311623451.f90e4f504d13d8a2740fc852cad77ca0. 2023-07-14 05:13:44,126 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689311623451.f90e4f504d13d8a2740fc852cad77ca0. 2023-07-14 05:13:44,126 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for f90e4f504d13d8a2740fc852cad77ca0: 2023-07-14 05:13:44,129 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 05:13:44,130 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689311623451.7c02b4f4e1320b7aba814144ec56468e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689311624130"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689311624130"}]},"ts":"1689311624130"} 2023-07-14 05:13:44,130 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689311623451.f90e4f504d13d8a2740fc852cad77ca0.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689311624130"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689311624130"}]},"ts":"1689311624130"} 2023-07-14 05:13:44,154 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 05:13:44,156 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 05:13:44,156 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689311624156"}]},"ts":"1689311624156"} 2023-07-14 05:13:44,158 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-14 05:13:44,213 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-14 05:13:44,216 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 05:13:44,216 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 05:13:44,216 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 05:13:44,216 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 05:13:44,216 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7c02b4f4e1320b7aba814144ec56468e, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f90e4f504d13d8a2740fc852cad77ca0, ASSIGN}] 2023-07-14 05:13:44,222 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f90e4f504d13d8a2740fc852cad77ca0, ASSIGN 2023-07-14 05:13:44,223 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7c02b4f4e1320b7aba814144ec56468e, ASSIGN 2023-07-14 05:13:44,225 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f90e4f504d13d8a2740fc852cad77ca0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35487,1689311513755; forceNewPlan=false, retain=false 2023-07-14 05:13:44,225 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7c02b4f4e1320b7aba814144ec56468e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43331,1689311513888; forceNewPlan=false, retain=false 2023-07-14 05:13:44,375 INFO [jenkins-hbase4:35845] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 05:13:44,379 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=f90e4f504d13d8a2740fc852cad77ca0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:44,379 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=7c02b4f4e1320b7aba814144ec56468e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:44,379 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689311623451.f90e4f504d13d8a2740fc852cad77ca0.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689311624379"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689311624379"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689311624379"}]},"ts":"1689311624379"} 2023-07-14 05:13:44,379 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689311623451.7c02b4f4e1320b7aba814144ec56468e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689311624379"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689311624379"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689311624379"}]},"ts":"1689311624379"} 2023-07-14 05:13:44,384 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure f90e4f504d13d8a2740fc852cad77ca0, server=jenkins-hbase4.apache.org,35487,1689311513755}] 2023-07-14 05:13:44,385 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 7c02b4f4e1320b7aba814144ec56468e, server=jenkins-hbase4.apache.org,43331,1689311513888}] 2023-07-14 05:13:44,542 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689311623451.7c02b4f4e1320b7aba814144ec56468e. 2023-07-14 05:13:44,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7c02b4f4e1320b7aba814144ec56468e, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689311623451.7c02b4f4e1320b7aba814144ec56468e.', STARTKEY => '', ENDKEY => '1'} 2023-07-14 05:13:44,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689311623451.7c02b4f4e1320b7aba814144ec56468e. service=AccessControlService 2023-07-14 05:13:44,542 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 05:13:44,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 7c02b4f4e1320b7aba814144ec56468e 2023-07-14 05:13:44,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689311623451.7c02b4f4e1320b7aba814144ec56468e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 05:13:44,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7c02b4f4e1320b7aba814144ec56468e 2023-07-14 05:13:44,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7c02b4f4e1320b7aba814144ec56468e 2023-07-14 05:13:44,547 INFO [StoreOpener-7c02b4f4e1320b7aba814144ec56468e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7c02b4f4e1320b7aba814144ec56468e 2023-07-14 05:13:44,550 DEBUG [StoreOpener-7c02b4f4e1320b7aba814144ec56468e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithSkipTmp/7c02b4f4e1320b7aba814144ec56468e/cf 2023-07-14 05:13:44,550 DEBUG [StoreOpener-7c02b4f4e1320b7aba814144ec56468e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithSkipTmp/7c02b4f4e1320b7aba814144ec56468e/cf 2023-07-14 05:13:44,558 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689311623451.f90e4f504d13d8a2740fc852cad77ca0. 2023-07-14 05:13:44,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f90e4f504d13d8a2740fc852cad77ca0, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689311623451.f90e4f504d13d8a2740fc852cad77ca0.', STARTKEY => '1', ENDKEY => ''} 2023-07-14 05:13:44,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689311623451.f90e4f504d13d8a2740fc852cad77ca0. service=AccessControlService 2023-07-14 05:13:44,558 INFO [StoreOpener-7c02b4f4e1320b7aba814144ec56468e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7c02b4f4e1320b7aba814144ec56468e columnFamilyName cf 2023-07-14 05:13:44,558 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 05:13:44,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp f90e4f504d13d8a2740fc852cad77ca0 2023-07-14 05:13:44,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689311623451.f90e4f504d13d8a2740fc852cad77ca0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 05:13:44,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f90e4f504d13d8a2740fc852cad77ca0 2023-07-14 05:13:44,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f90e4f504d13d8a2740fc852cad77ca0 2023-07-14 05:13:44,561 INFO [StoreOpener-7c02b4f4e1320b7aba814144ec56468e-1] regionserver.HStore(310): Store=7c02b4f4e1320b7aba814144ec56468e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 05:13:44,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-14 05:13:44,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithSkipTmp/7c02b4f4e1320b7aba814144ec56468e 2023-07-14 05:13:44,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithSkipTmp/7c02b4f4e1320b7aba814144ec56468e 2023-07-14 05:13:44,571 INFO [StoreOpener-f90e4f504d13d8a2740fc852cad77ca0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f90e4f504d13d8a2740fc852cad77ca0 2023-07-14 05:13:44,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7c02b4f4e1320b7aba814144ec56468e 2023-07-14 05:13:44,573 DEBUG [StoreOpener-f90e4f504d13d8a2740fc852cad77ca0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithSkipTmp/f90e4f504d13d8a2740fc852cad77ca0/cf 2023-07-14 05:13:44,573 DEBUG [StoreOpener-f90e4f504d13d8a2740fc852cad77ca0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithSkipTmp/f90e4f504d13d8a2740fc852cad77ca0/cf 2023-07-14 05:13:44,573 INFO [StoreOpener-f90e4f504d13d8a2740fc852cad77ca0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f90e4f504d13d8a2740fc852cad77ca0 columnFamilyName cf 2023-07-14 05:13:44,574 INFO [StoreOpener-f90e4f504d13d8a2740fc852cad77ca0-1] regionserver.HStore(310): Store=f90e4f504d13d8a2740fc852cad77ca0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 05:13:44,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithSkipTmp/f90e4f504d13d8a2740fc852cad77ca0 2023-07-14 05:13:44,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithSkipTmp/7c02b4f4e1320b7aba814144ec56468e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 05:13:44,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithSkipTmp/f90e4f504d13d8a2740fc852cad77ca0 2023-07-14 05:13:44,579 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7c02b4f4e1320b7aba814144ec56468e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67631461, jitterRate=0.007787302136421204}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 05:13:44,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7c02b4f4e1320b7aba814144ec56468e: 2023-07-14 05:13:44,581 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689311623451.7c02b4f4e1320b7aba814144ec56468e., pid=109, masterSystemTime=1689311624537 2023-07-14 05:13:44,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689311623451.7c02b4f4e1320b7aba814144ec56468e. 2023-07-14 05:13:44,583 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689311623451.7c02b4f4e1320b7aba814144ec56468e. 2023-07-14 05:13:44,583 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=7c02b4f4e1320b7aba814144ec56468e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:44,583 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689311623451.7c02b4f4e1320b7aba814144ec56468e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689311624583"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689311624583"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689311624583"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689311624583"}]},"ts":"1689311624583"} 2023-07-14 05:13:44,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f90e4f504d13d8a2740fc852cad77ca0 2023-07-14 05:13:44,593 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-14 05:13:44,593 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 7c02b4f4e1320b7aba814144ec56468e, server=jenkins-hbase4.apache.org,43331,1689311513888 in 206 msec 2023-07-14 05:13:44,595 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7c02b4f4e1320b7aba814144ec56468e, ASSIGN in 377 msec 2023-07-14 05:13:44,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithSkipTmp/f90e4f504d13d8a2740fc852cad77ca0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 05:13:44,604 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f90e4f504d13d8a2740fc852cad77ca0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59706920, jitterRate=-0.1102975606918335}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 05:13:44,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f90e4f504d13d8a2740fc852cad77ca0: 2023-07-14 05:13:44,605 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689311623451.f90e4f504d13d8a2740fc852cad77ca0., pid=108, masterSystemTime=1689311624537 2023-07-14 05:13:44,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689311623451.f90e4f504d13d8a2740fc852cad77ca0. 2023-07-14 05:13:44,607 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689311623451.f90e4f504d13d8a2740fc852cad77ca0. 2023-07-14 05:13:44,607 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=f90e4f504d13d8a2740fc852cad77ca0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:44,607 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689311623451.f90e4f504d13d8a2740fc852cad77ca0.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689311624607"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689311624607"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689311624607"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689311624607"}]},"ts":"1689311624607"} 2023-07-14 05:13:44,619 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-14 05:13:44,619 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure f90e4f504d13d8a2740fc852cad77ca0, server=jenkins-hbase4.apache.org,35487,1689311513755 in 231 msec 2023-07-14 05:13:44,624 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-07-14 05:13:44,624 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f90e4f504d13d8a2740fc852cad77ca0, ASSIGN in 403 msec 2023-07-14 05:13:44,626 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 05:13:44,626 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689311624626"}]},"ts":"1689311624626"} 2023-07-14 05:13:44,629 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-14 05:13:44,631 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 05:13:44,632 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-14 05:13:44,635 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35487] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-14 05:13:44,638 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 05:13:44,638 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 05:13:44,638 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 05:13:44,638 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 05:13:44,646 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-14 05:13:44,647 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-14 05:13:44,647 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-14 05:13:44,647 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-14 05:13:44,650 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 1.1950 sec 2023-07-14 05:13:45,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-14 05:13:45,566 INFO [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-14 05:13:45,567 DEBUG [Listener at jenkins-hbase4.apache.org/38651] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithSkipTmp get assigned. Timeout = 60000ms 2023-07-14 05:13:45,567 INFO [Listener at jenkins-hbase4.apache.org/38651] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 05:13:45,578 INFO [Listener at jenkins-hbase4.apache.org/38651] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned to meta. Checking AM states. 2023-07-14 05:13:45,578 INFO [Listener at jenkins-hbase4.apache.org/38651] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 05:13:45,578 INFO [Listener at jenkins-hbase4.apache.org/38651] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned. 2023-07-14 05:13:45,594 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-14 05:13:45,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689311625594 (current time:1689311625594). 2023-07-14 05:13:45,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 05:13:45,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] zookeeper.ReadOnlyZKClient(139): Connect 0x7f54bdf6 to 127.0.0.1:55310 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 05:13:45,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a62dae9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 05:13:45,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 05:13:45,618 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51902, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 05:13:45,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7f54bdf6 to 127.0.0.1:55310 2023-07-14 05:13:45,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 05:13:45,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] zookeeper.ReadOnlyZKClient(139): Connect 0x512e0bd2 to 127.0.0.1:55310 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 05:13:45,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b4fa70c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 05:13:45,649 DEBUG [hconnection-0x17e6811e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 05:13:45,653 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51914, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 05:13:45,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 05:13:45,660 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39480, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 05:13:45,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x512e0bd2 to 127.0.0.1:55310 2023-07-14 05:13:45,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 05:13:45,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-14 05:13:45,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 05:13:45,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-14 05:13:45,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-14 05:13:45,669 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-14 05:13:45,669 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689312225669 2023-07-14 05:13:45,669 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-14 05:13:45,670 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 05:13:45,671 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 05:13:45,678 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-14 05:13:45,679 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-14 05:13:45,680 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 13 msec 2023-07-14 05:13:45,684 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-14 05:13:45,684 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689312225684 2023-07-14 05:13:45,711 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,711 INFO [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-14 05:13:45,711 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 05:13:45,713 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-14 05:13:45,713 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-14 05:13:45,714 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,714 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,715 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:13:45,715 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:45,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:13:45,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:13:45,716 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:13:45,715 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:13:45,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:13:45,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:13:45,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:13:45,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:13:45,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,716 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:45,716 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:45,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,717 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:45,717 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 05:13:45,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,717 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,717 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,717 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-14 05:13:45,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,718 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-14 05:13:45,718 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,718 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-14 05:13:45,718 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 05:13:45,720 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-14 05:13:45,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-14 05:13:45,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,721 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-14 05:13:45,720 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-14 05:13:45,721 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35487,1689311513755' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-14 05:13:45,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-14 05:13:45,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,726 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-14 05:13:45,727 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,727 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-14 05:13:45,727 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 05:13:45,728 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,728 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-14 05:13:45,728 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 05:13:45,729 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:45,729 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:45,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:13:45,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:13:45,730 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,730 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 05:13:45,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:13:45,732 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-14 05:13:45,733 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-14 05:13:45,733 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35535,1689311513825' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-14 05:13:45,732 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-14 05:13:45,733 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-14 05:13:45,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:13:45,733 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43331,1689311513888' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-14 05:13:45,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:45,740 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,741 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:45,741 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,741 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,741 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 05:13:45,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:45,741 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,741 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 05:13:45,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:13:45,741 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35487,1689311513755' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-14 05:13:45,742 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@454add4f[Count = 1] remaining members to acquire global barrier 2023-07-14 05:13:45,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:45,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:13:45,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:13:45,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:13:45,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:13:45,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:45,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:45,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:45,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:13:45,747 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43331,1689311513888' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-14 05:13:45,747 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@454add4f[Count = 0] remaining members to acquire global barrier 2023-07-14 05:13:45,747 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-14 05:13:45,747 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,749 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,749 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,750 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-14 05:13:45,749 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-14 05:13:45,750 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-14 05:13:45,750 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35535,1689311513825' in zk 2023-07-14 05:13:45,750 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 05:13:45,750 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 05:13:45,750 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689311623451.f90e4f504d13d8a2740fc852cad77ca0. 2023-07-14 05:13:45,750 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,750 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689311623451.f90e4f504d13d8a2740fc852cad77ca0. started... 2023-07-14 05:13:45,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,751 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-14 05:13:45,751 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:45,752 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:45,752 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 05:13:45,758 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 05:13:45,773 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 05:13:45,773 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 05:13:45,773 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f90e4f504d13d8a2740fc852cad77ca0: 2023-07-14 05:13:45,773 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689311623451.f90e4f504d13d8a2740fc852cad77ca0.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,773 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 05:13:45,773 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 05:13:45,773 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689311623451.7c02b4f4e1320b7aba814144ec56468e. 2023-07-14 05:13:45,773 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-14 05:13:45,774 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 05:13:45,774 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-14 05:13:45,774 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689311623451.7c02b4f4e1320b7aba814144ec56468e. started... 2023-07-14 05:13:45,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-14 05:13:45,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-14 05:13:45,774 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 05:13:45,776 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7c02b4f4e1320b7aba814144ec56468e: 2023-07-14 05:13:45,778 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689311623451.7c02b4f4e1320b7aba814144ec56468e.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,778 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 05:13:45,778 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 05:13:45,888 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689311623451.7c02b4f4e1320b7aba814144ec56468e. completed. 2023-07-14 05:13:45,889 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689311623451.7c02b4f4e1320b7aba814144ec56468e. 2023-07-14 05:13:45,889 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 05:13:45,889 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 05:13:45,889 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:45,889 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-14 05:13:45,889 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43331,1689311513888' in zk 2023-07-14 05:13:45,890 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689311623451.f90e4f504d13d8a2740fc852cad77ca0. completed. 2023-07-14 05:13:45,890 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689311623451.f90e4f504d13d8a2740fc852cad77ca0. 2023-07-14 05:13:45,890 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 05:13:45,890 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 05:13:45,890 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:45,890 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-14 05:13:45,890 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35487,1689311513755' in zk 2023-07-14 05:13:45,891 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:45,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:45,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:13:45,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:13:45,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:13:45,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:13:45,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:45,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:45,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:45,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:13:45,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,895 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-14 05:13:45,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:45,895 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 05:13:45,895 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-14 05:13:45,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:45,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,43331,1689311513888': 2023-07-14 05:13:45,896 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43331,1689311513888' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-14 05:13:45,897 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:45,897 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-14 05:13:45,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:45,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:13:45,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:13:45,897 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 05:13:45,898 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-14 05:13:45,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:13:45,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:13:45,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:45,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:45,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:45,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:13:45,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:45,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:45,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:45,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,35487,1689311513755': 2023-07-14 05:13:45,912 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35487,1689311513755' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-14 05:13:45,913 INFO [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-14 05:13:45,913 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 05:13:45,913 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 05:13:45,913 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,913 INFO [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 05:13:45,915 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,915 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:13:45,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,915 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,916 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,916 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:13:45,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:13:45,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:13:45,915 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,916 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:13:45,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:13:45,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:13:45,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:13:45,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:13:45,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:13:45,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:13:45,917 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:45,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:13:45,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,918 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:45,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,918 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:45,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:13:45,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:45,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:45,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:45,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:13:45,921 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:45,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,922 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:45,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:45,922 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:45,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:45,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:45,925 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:45,925 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,925 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:13:45,925 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:13:45,926 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:13:45,925 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:13:45,925 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:45,926 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,926 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 05:13:45,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:13:45,926 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:13:45,926 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:13:45,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:13:45,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:13:45,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:13:45,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:13:45,926 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:13:45,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:13:45,926 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:45,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:13:45,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:13:45,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:13:45,928 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,929 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:45,929 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,929 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:45,929 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:45,929 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,929 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,929 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:13:45,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:13:45,957 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:45,978 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 05:13:45,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-14 05:13:45,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-14 05:13:45,979 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 05:13:46,010 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-14 05:13:46,010 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:46,011 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:46,011 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689311625669Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689311625926 (+257 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689311625928 (+2 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689311625932 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689311625950 (+18 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689311626010 (+60 ms) 2023-07-14 05:13:46,014 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-14 05:13:46,015 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 343 msec 2023-07-14 05:13:46,279 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 05:13:46,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-14 05:13:46,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 05:13:46,307 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43331] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689311623451.7c02b4f4e1320b7aba814144ec56468e. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 05:13:46,308 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35487] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689311623451.f90e4f504d13d8a2740fc852cad77ca0. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 05:13:46,311 DEBUG [Listener at jenkins-hbase4.apache.org/38651] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:46,311 DEBUG [Listener at jenkins-hbase4.apache.org/38651] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689311623451.7c02b4f4e1320b7aba814144ec56468e. 2023-07-14 05:13:46,313 INFO [Listener at jenkins-hbase4.apache.org/38651] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 05:13:46,339 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-14 05:13:46,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689311626339 (current time:1689311626339). 2023-07-14 05:13:46,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 05:13:46,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] zookeeper.ReadOnlyZKClient(139): Connect 0x49822516 to 127.0.0.1:55310 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 05:13:46,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a4fa349, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 05:13:46,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 05:13:46,381 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51926, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 05:13:46,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x49822516 to 127.0.0.1:55310 2023-07-14 05:13:46,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 05:13:46,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] zookeeper.ReadOnlyZKClient(139): Connect 0x44f4d78b to 127.0.0.1:55310 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 05:13:46,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1c86f096, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 05:13:46,407 DEBUG [hconnection-0xb444da4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 05:13:46,408 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51930, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 05:13:46,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 05:13:46,417 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39484, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 05:13:46,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x44f4d78b to 127.0.0.1:55310 2023-07-14 05:13:46,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 05:13:46,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-14 05:13:46,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 05:13:46,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-14 05:13:46,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-14 05:13:46,428 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-14 05:13:46,429 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689312226429 2023-07-14 05:13:46,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-14 05:13:46,429 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:46,431 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 05:13:46,431 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 05:13:46,432 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-14 05:13:46,435 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-14 05:13:46,436 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 12 msec 2023-07-14 05:13:46,442 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-14 05:13:46,443 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689312226443 2023-07-14 05:13:46,528 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:46,528 INFO [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-14 05:13:46,528 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 05:13:46,530 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-14 05:13:46,530 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-14 05:13:46,530 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:46,530 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:46,531 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 05:13:46,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-14 05:13:46,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-14 05:13:46,533 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 05:13:46,533 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:13:46,533 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:13:46,533 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:46,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:13:46,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:13:46,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:13:46,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:13:46,533 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:13:46,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:13:46,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:13:46,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:46,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:46,534 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:46,534 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:46,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:46,534 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:46,535 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:46,535 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:46,535 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:46,535 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 05:13:46,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-14 05:13:46,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:46,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-14 05:13:46,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:46,535 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-14 05:13:46,535 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-14 05:13:46,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-14 05:13:46,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:46,536 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-14 05:13:46,548 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:46,548 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-14 05:13:46,548 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 05:13:46,549 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:46,551 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:46,551 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-14 05:13:46,555 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-14 05:13:46,555 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 05:13:46,555 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-14 05:13:46,557 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 05:13:46,555 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-14 05:13:46,559 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43331,1689311513888' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-14 05:13:46,559 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-14 05:13:46,559 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-14 05:13:46,559 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35535,1689311513825' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-14 05:13:46,558 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-14 05:13:46,559 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-14 05:13:46,559 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35487,1689311513755' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-14 05:13:46,561 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:46,561 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:46,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:46,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:13:46,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:13:46,561 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:46,562 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:46,562 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:46,562 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:46,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:13:46,562 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 05:13:46,562 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:46,562 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 05:13:46,562 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:46,562 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 05:13:46,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:13:46,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:46,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:46,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:46,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:46,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:13:46,566 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43331,1689311513888' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-14 05:13:46,566 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46f80d47[Count = 1] remaining members to acquire global barrier 2023-07-14 05:13:46,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:46,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:13:46,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:13:46,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:13:46,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:13:46,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:46,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:46,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:46,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:46,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:13:46,571 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35487,1689311513755' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-14 05:13:46,571 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46f80d47[Count = 0] remaining members to acquire global barrier 2023-07-14 05:13:46,571 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-14 05:13:46,571 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:46,577 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:46,577 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:46,577 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:46,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:46,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:46,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:46,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:46,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:46,578 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-14 05:13:46,578 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:46,578 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 05:13:46,578 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 05:13:46,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:46,578 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-14 05:13:46,578 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-14 05:13:46,578 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-14 05:13:46,578 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35535,1689311513825' in zk 2023-07-14 05:13:46,578 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689311623451.7c02b4f4e1320b7aba814144ec56468e. 2023-07-14 05:13:46,578 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689311623451.7c02b4f4e1320b7aba814144ec56468e. started... 2023-07-14 05:13:46,579 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:46,579 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 05:13:46,579 INFO [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 7c02b4f4e1320b7aba814144ec56468e 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-14 05:13:46,580 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-14 05:13:46,581 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 05:13:46,581 DEBUG [member: 'jenkins-hbase4.apache.org,35535,1689311513825' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-14 05:13:46,588 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 05:13:46,588 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 05:13:46,588 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689311623451.f90e4f504d13d8a2740fc852cad77ca0. 2023-07-14 05:13:46,589 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689311623451.f90e4f504d13d8a2740fc852cad77ca0. started... 2023-07-14 05:13:46,589 INFO [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f90e4f504d13d8a2740fc852cad77ca0 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-14 05:13:46,653 INFO [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithSkipTmp/f90e4f504d13d8a2740fc852cad77ca0/.tmp/cf/f4abcb498c2c46ea93dbf26432c1e3b0 2023-07-14 05:13:46,668 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithSkipTmp/f90e4f504d13d8a2740fc852cad77ca0/.tmp/cf/f4abcb498c2c46ea93dbf26432c1e3b0 as hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithSkipTmp/f90e4f504d13d8a2740fc852cad77ca0/cf/f4abcb498c2c46ea93dbf26432c1e3b0 2023-07-14 05:13:46,673 INFO [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithSkipTmp/7c02b4f4e1320b7aba814144ec56468e/.tmp/cf/422171b482aa43e293bd55b76bdc2d85 2023-07-14 05:13:46,677 INFO [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithSkipTmp/f90e4f504d13d8a2740fc852cad77ca0/cf/f4abcb498c2c46ea93dbf26432c1e3b0, entries=46, sequenceid=6, filesize=7.9 K 2023-07-14 05:13:46,679 INFO [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for f90e4f504d13d8a2740fc852cad77ca0 in 90ms, sequenceid=6, compaction requested=false 2023-07-14 05:13:46,679 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-14 05:13:46,680 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f90e4f504d13d8a2740fc852cad77ca0: 2023-07-14 05:13:46,680 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689311623451.f90e4f504d13d8a2740fc852cad77ca0.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:46,680 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 05:13:46,680 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithSkipTmp/f90e4f504d13d8a2740fc852cad77ca0/cf/f4abcb498c2c46ea93dbf26432c1e3b0] hfiles 2023-07-14 05:13:46,680 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithSkipTmp/f90e4f504d13d8a2740fc852cad77ca0/cf/f4abcb498c2c46ea93dbf26432c1e3b0 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:46,682 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithSkipTmp/7c02b4f4e1320b7aba814144ec56468e/.tmp/cf/422171b482aa43e293bd55b76bdc2d85 as hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithSkipTmp/7c02b4f4e1320b7aba814144ec56468e/cf/422171b482aa43e293bd55b76bdc2d85 2023-07-14 05:13:46,690 INFO [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithSkipTmp/7c02b4f4e1320b7aba814144ec56468e/cf/422171b482aa43e293bd55b76bdc2d85, entries=4, sequenceid=6, filesize=5.1 K 2023-07-14 05:13:46,691 INFO [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 7c02b4f4e1320b7aba814144ec56468e in 112ms, sequenceid=6, compaction requested=false 2023-07-14 05:13:46,693 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7c02b4f4e1320b7aba814144ec56468e: 2023-07-14 05:13:46,693 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689311623451.7c02b4f4e1320b7aba814144ec56468e.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:46,693 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 05:13:46,693 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithSkipTmp/7c02b4f4e1320b7aba814144ec56468e/cf/422171b482aa43e293bd55b76bdc2d85] hfiles 2023-07-14 05:13:46,693 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithSkipTmp/7c02b4f4e1320b7aba814144ec56468e/cf/422171b482aa43e293bd55b76bdc2d85 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:46,733 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 05:13:46,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-14 05:13:46,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-14 05:13:46,734 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 05:13:46,763 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689311623451.7c02b4f4e1320b7aba814144ec56468e. completed. 2023-07-14 05:13:46,763 DEBUG [rs(jenkins-hbase4.apache.org,43331,1689311513888)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689311623451.7c02b4f4e1320b7aba814144ec56468e. 2023-07-14 05:13:46,763 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 05:13:46,764 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 05:13:46,764 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:46,764 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-14 05:13:46,764 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43331,1689311513888' in zk 2023-07-14 05:13:46,766 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:46,767 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-14 05:13:46,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:46,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:13:46,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:13:46,767 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 05:13:46,767 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1689311513888' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-14 05:13:46,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:13:46,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:13:46,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:46,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:46,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:46,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:46,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:13:46,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:46,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:46,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:46,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,43331,1689311513888': 2023-07-14 05:13:46,775 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43331,1689311513888' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-14 05:13:47,034 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 05:13:47,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-14 05:13:47,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-14 05:13:47,040 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-14 05:13:47,163 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689311623451.f90e4f504d13d8a2740fc852cad77ca0. completed. 2023-07-14 05:13:47,163 DEBUG [rs(jenkins-hbase4.apache.org,35487,1689311513755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689311623451.f90e4f504d13d8a2740fc852cad77ca0. 2023-07-14 05:13:47,163 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 05:13:47,163 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 05:13:47,163 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:47,164 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-14 05:13:47,164 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35487,1689311513755' in zk 2023-07-14 05:13:47,166 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-14 05:13:47,166 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 05:13:47,166 DEBUG [member: 'jenkins-hbase4.apache.org,35487,1689311513755' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-14 05:13:47,168 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:47,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:47,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:13:47,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:13:47,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:13:47,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:13:47,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:47,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:47,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:47,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:47,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:13:47,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:47,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:47,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:47,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:47,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,35487,1689311513755': 2023-07-14 05:13:47,178 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35487,1689311513755' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-14 05:13:47,178 INFO [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-14 05:13:47,179 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 05:13:47,179 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 05:13:47,179 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:47,179 INFO [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 05:13:47,182 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:47,182 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:47,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:47,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:47,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:47,183 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:13:47,182 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:13:47,182 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:47,182 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:47,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:47,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:47,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 05:13:47,183 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:47,183 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:13:47,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:47,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 05:13:47,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:47,184 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:47,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:13:47,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:13:47,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 05:13:47,184 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:47,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:47,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:47,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:13:47,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:13:47,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:13:47,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:13:47,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 05:13:47,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:47,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:47,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:47,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:47,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:47,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:47,190 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:47,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 05:13:47,190 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:47,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:47,190 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:47,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:47,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:47,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:47,194 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:13:47,194 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:13:47,194 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 05:13:47,194 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:13:47,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:13:47,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:13:47,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:13:47,194 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:13:47,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:13:47,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 05:13:47,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 05:13:47,194 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 05:13:47,194 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:47,194 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:47,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:13:47,194 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:47,194 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:47,194 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:47,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:13:47,194 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:13:47,195 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:47,195 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:13:47,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:13:47,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:13:47,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 05:13:47,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 05:13:47,195 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:47,195 DEBUG [(jenkins-hbase4.apache.org,35845,1689311512312)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 05:13:47,195 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:47,195 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:13:47,197 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:47,197 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:47,198 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:47,240 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:47,540 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 05:13:47,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-14 05:13:47,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-14 05:13:47,542 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-14 05:13:47,672 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-14 05:13:47,672 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:47,672 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:47,672 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689311626429Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689311627195 (+766 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689311627197 (+2 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689311627201 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689311627225 (+24 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689311627672 (+447 ms) 2023-07-14 05:13:47,675 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-14 05:13:47,676 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 1.2450 sec 2023-07-14 05:13:48,005 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689311521774_0006_000001 (auth:SIMPLE) 2023-07-14 05:13:48,542 DEBUG [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 05:13:48,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-14 05:13:48,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 05:13:48,543 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/export-test/export-1689311628543 2023-07-14 05:13:48,544 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36535, tgtDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/export-test/export-1689311628543, rawTgtDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/export-test/export-1689311628543, srcFsUri=hdfs://localhost:36535, srcDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48 2023-07-14 05:13:48,576 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36535, inputRoot=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48 2023-07-14 05:13:48,576 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1598239217_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/export-test/export-1689311628543, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/export-test/export-1689311628543/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:48,576 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36535, inputRoot=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48, snapshotDir=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-14 05:13:48,584 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/export-test/export-1689311628543/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:13:48,607 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 05:13:48,607 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 05:13:48,608 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 05:13:48,608 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 05:13:48,608 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-14 05:13:48,608 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 05:13:48,609 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 05:13:48,677 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/hadoop-7043853172026117709.jar 2023-07-14 05:13:48,677 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 05:13:48,678 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 05:13:48,678 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 05:13:48,678 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 05:13:48,679 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 05:13:48,679 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 05:13:48,679 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 05:13:48,680 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 05:13:48,680 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 05:13:48,680 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 05:13:48,681 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 05:13:48,681 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 05:13:48,681 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 05:13:48,682 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 05:13:48,682 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 05:13:48,683 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 05:13:48,683 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 05:13:48,683 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 05:13:48,684 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 05:13:48,684 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 05:13:48,684 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 05:13:48,684 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 05:13:48,685 DEBUG [Listener at jenkins-hbase4.apache.org/38651] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 05:13:48,717 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 05:13:50,224 WARN [Listener at jenkins-hbase4.apache.org/38651] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 05:13:50,227 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-14 05:13:50,229 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-14 05:13:50,397 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 05:13:50,397 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 05:13:51,015 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689311521774_0007_000001 (auth:SIMPLE) 2023-07-14 05:13:56,905 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689311521774_0007_000001 (auth:SIMPLE) 2023-07-14 05:13:59,271 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689311521774_0007_000001 (auth:SIMPLE) 2023-07-14 05:14:02,901 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689311521774_0007_000001 (auth:SIMPLE) 2023-07-14 05:14:04,590 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 05:14:04,591 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 05:14:04,625 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:14:04,625 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 05:14:04,625 INFO [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 05:14:04,626 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-839015254_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:14:04,626 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(367): hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-14 05:14:04,626 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(367): hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-14 05:14:04,626 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-839015254_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/export-test/export-1689311628543/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/export-test/export-1689311628543/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:14:04,627 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(367): hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/export-test/export-1689311628543/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-14 05:14:04,627 DEBUG [Listener at jenkins-hbase4.apache.org/38651] snapshot.TestExportSnapshot(367): hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/export-test/export-1689311628543/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-14 05:14:04,633 INFO [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 05:14:04,634 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 05:14:04,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 05:14:04,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-14 05:14:04,648 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689311644648"}]},"ts":"1689311644648"} 2023-07-14 05:14:04,650 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-14 05:14:04,652 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-14 05:14:04,653 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7c02b4f4e1320b7aba814144ec56468e, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f90e4f504d13d8a2740fc852cad77ca0, UNASSIGN}] 2023-07-14 05:14:04,654 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f90e4f504d13d8a2740fc852cad77ca0, UNASSIGN 2023-07-14 05:14:04,656 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7c02b4f4e1320b7aba814144ec56468e, UNASSIGN 2023-07-14 05:14:04,657 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=f90e4f504d13d8a2740fc852cad77ca0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:14:04,657 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=7c02b4f4e1320b7aba814144ec56468e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:14:04,657 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689311623451.7c02b4f4e1320b7aba814144ec56468e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689311644657"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689311644657"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689311644657"}]},"ts":"1689311644657"} 2023-07-14 05:14:04,657 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689311623451.f90e4f504d13d8a2740fc852cad77ca0.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689311644657"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689311644657"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689311644657"}]},"ts":"1689311644657"} 2023-07-14 05:14:04,659 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 7c02b4f4e1320b7aba814144ec56468e, server=jenkins-hbase4.apache.org,43331,1689311513888}] 2023-07-14 05:14:04,660 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure f90e4f504d13d8a2740fc852cad77ca0, server=jenkins-hbase4.apache.org,35487,1689311513755}] 2023-07-14 05:14:04,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-14 05:14:04,811 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7c02b4f4e1320b7aba814144ec56468e 2023-07-14 05:14:04,811 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7c02b4f4e1320b7aba814144ec56468e, disabling compactions & flushes 2023-07-14 05:14:04,811 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689311623451.7c02b4f4e1320b7aba814144ec56468e. 2023-07-14 05:14:04,811 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689311623451.7c02b4f4e1320b7aba814144ec56468e. 2023-07-14 05:14:04,812 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689311623451.7c02b4f4e1320b7aba814144ec56468e. after waiting 0 ms 2023-07-14 05:14:04,812 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689311623451.7c02b4f4e1320b7aba814144ec56468e. 2023-07-14 05:14:04,817 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f90e4f504d13d8a2740fc852cad77ca0 2023-07-14 05:14:04,817 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f90e4f504d13d8a2740fc852cad77ca0, disabling compactions & flushes 2023-07-14 05:14:04,818 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689311623451.f90e4f504d13d8a2740fc852cad77ca0. 2023-07-14 05:14:04,818 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689311623451.f90e4f504d13d8a2740fc852cad77ca0. 2023-07-14 05:14:04,818 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689311623451.f90e4f504d13d8a2740fc852cad77ca0. after waiting 0 ms 2023-07-14 05:14:04,818 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689311623451.f90e4f504d13d8a2740fc852cad77ca0. 2023-07-14 05:14:04,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithSkipTmp/7c02b4f4e1320b7aba814144ec56468e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 05:14:04,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 05:14:04,833 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689311623451.7c02b4f4e1320b7aba814144ec56468e. 2023-07-14 05:14:04,833 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7c02b4f4e1320b7aba814144ec56468e: 2023-07-14 05:14:04,835 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7c02b4f4e1320b7aba814144ec56468e 2023-07-14 05:14:04,835 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/default/testtb-testExportFileSystemStateWithSkipTmp/f90e4f504d13d8a2740fc852cad77ca0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 05:14:04,835 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=7c02b4f4e1320b7aba814144ec56468e, regionState=CLOSED 2023-07-14 05:14:04,835 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689311623451.7c02b4f4e1320b7aba814144ec56468e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689311644835"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689311644835"}]},"ts":"1689311644835"} 2023-07-14 05:14:04,835 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 05:14:04,836 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689311623451.f90e4f504d13d8a2740fc852cad77ca0. 2023-07-14 05:14:04,836 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f90e4f504d13d8a2740fc852cad77ca0: 2023-07-14 05:14:04,838 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f90e4f504d13d8a2740fc852cad77ca0 2023-07-14 05:14:04,839 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=f90e4f504d13d8a2740fc852cad77ca0, regionState=CLOSED 2023-07-14 05:14:04,839 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689311623451.f90e4f504d13d8a2740fc852cad77ca0.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689311644839"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689311644839"}]},"ts":"1689311644839"} 2023-07-14 05:14:04,840 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-14 05:14:04,841 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 7c02b4f4e1320b7aba814144ec56468e, server=jenkins-hbase4.apache.org,43331,1689311513888 in 179 msec 2023-07-14 05:14:04,842 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7c02b4f4e1320b7aba814144ec56468e, UNASSIGN in 187 msec 2023-07-14 05:14:04,843 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-14 05:14:04,843 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure f90e4f504d13d8a2740fc852cad77ca0, server=jenkins-hbase4.apache.org,35487,1689311513755 in 181 msec 2023-07-14 05:14:04,845 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-14 05:14:04,845 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f90e4f504d13d8a2740fc852cad77ca0, UNASSIGN in 190 msec 2023-07-14 05:14:04,847 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689311644847"}]},"ts":"1689311644847"} 2023-07-14 05:14:04,849 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-14 05:14:04,850 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-14 05:14:04,857 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 221 msec 2023-07-14 05:14:04,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-14 05:14:04,952 INFO [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-14 05:14:04,953 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 05:14:04,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 05:14:04,956 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 05:14:04,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 05:14:04,958 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 05:14:04,959 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35487] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 05:14:04,963 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 05:14:04,963 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 05:14:04,963 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 05:14:04,963 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 05:14:04,963 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-14 05:14:04,963 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-14 05:14:04,964 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-14 05:14:04,964 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-14 05:14:04,964 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 05:14:04,964 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 05:14:04,964 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 05:14:04,965 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 05:14:04,965 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 05:14:04,965 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 05:14:04,964 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 05:14:04,965 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 05:14:04,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-14 05:14:04,969 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7c02b4f4e1320b7aba814144ec56468e 2023-07-14 05:14:04,969 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f90e4f504d13d8a2740fc852cad77ca0 2023-07-14 05:14:04,971 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7c02b4f4e1320b7aba814144ec56468e/cf, FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7c02b4f4e1320b7aba814144ec56468e/recovered.edits] 2023-07-14 05:14:04,971 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f90e4f504d13d8a2740fc852cad77ca0/cf, FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f90e4f504d13d8a2740fc852cad77ca0/recovered.edits] 2023-07-14 05:14:04,977 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f90e4f504d13d8a2740fc852cad77ca0/cf/f4abcb498c2c46ea93dbf26432c1e3b0 to hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/f90e4f504d13d8a2740fc852cad77ca0/cf/f4abcb498c2c46ea93dbf26432c1e3b0 2023-07-14 05:14:04,977 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7c02b4f4e1320b7aba814144ec56468e/cf/422171b482aa43e293bd55b76bdc2d85 to hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/7c02b4f4e1320b7aba814144ec56468e/cf/422171b482aa43e293bd55b76bdc2d85 2023-07-14 05:14:04,981 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7c02b4f4e1320b7aba814144ec56468e/recovered.edits/9.seqid to hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/7c02b4f4e1320b7aba814144ec56468e/recovered.edits/9.seqid 2023-07-14 05:14:04,981 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f90e4f504d13d8a2740fc852cad77ca0/recovered.edits/9.seqid to hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/f90e4f504d13d8a2740fc852cad77ca0/recovered.edits/9.seqid 2023-07-14 05:14:04,981 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7c02b4f4e1320b7aba814144ec56468e 2023-07-14 05:14:04,981 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f90e4f504d13d8a2740fc852cad77ca0 2023-07-14 05:14:04,982 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-14 05:14:04,984 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 05:14:04,986 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-14 05:14:04,988 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-14 05:14:04,989 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 05:14:04,989 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-14 05:14:04,989 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689311623451.7c02b4f4e1320b7aba814144ec56468e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689311644989"}]},"ts":"9223372036854775807"} 2023-07-14 05:14:04,989 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689311623451.f90e4f504d13d8a2740fc852cad77ca0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689311644989"}]},"ts":"9223372036854775807"} 2023-07-14 05:14:04,995 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-14 05:14:04,995 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 7c02b4f4e1320b7aba814144ec56468e, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689311623451.7c02b4f4e1320b7aba814144ec56468e.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => f90e4f504d13d8a2740fc852cad77ca0, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689311623451.f90e4f504d13d8a2740fc852cad77ca0.', STARTKEY => '1', ENDKEY => ''}] 2023-07-14 05:14:04,995 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-14 05:14:04,996 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689311644995"}]},"ts":"9223372036854775807"} 2023-07-14 05:14:05,000 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-14 05:14:05,002 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 05:14:05,004 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 49 msec 2023-07-14 05:14:05,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-14 05:14:05,067 INFO [Listener at jenkins-hbase4.apache.org/38651] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-14 05:14:05,077 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-14 05:14:05,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:14:05,081 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-14 05:14:05,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35845] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 05:14:05,120 INFO [Listener at jenkins-hbase4.apache.org/38651] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=764 (was 763) Potentially hanging thread: hconnection-0x11720e3f-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x11720e3f-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5087 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_235572928_1 at /127.0.0.1:49066 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_235572928_1 at /127.0.0.1:53010 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x11720e3f-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x11720e3f-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-839015254_17 at /127.0.0.1:44886 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (145847449) connection to jenkins-hbase4.apache.org/172.31.14.131:36633 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-839015254_17 at /127.0.0.1:53028 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-839015254_17 at /127.0.0.1:49104 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=903 (was 925), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=750 (was 640) - SystemLoadAverage LEAK? -, ProcessCount=187 (was 184) - ProcessCount LEAK? -, AvailableMemoryMB=2177 (was 3012) 2023-07-14 05:14:05,120 WARN [Listener at jenkins-hbase4.apache.org/38651] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-14 05:14:05,120 INFO [Listener at jenkins-hbase4.apache.org/38651] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-14 05:14:05,148 INFO [Listener at jenkins-hbase4.apache.org/38651] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-14 05:14:05,263 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1689311521774_0007_01_000001 is : 143 2023-07-14 05:14:10,404 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 05:14:19,278 INFO [Listener at jenkins-hbase4.apache.org/38651] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-14 05:14:33,404 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-14 05:14:33,405 INFO [Listener at jenkins-hbase4.apache.org/38651] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-14 05:14:33,520 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-14 05:14:33,539 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-14 05:14:33,541 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-14 05:14:33,554 INFO [Listener at jenkins-hbase4.apache.org/38651] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-14 05:14:33,658 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-14 05:14:33,658 INFO [Listener at jenkins-hbase4.apache.org/38651] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-14 05:14:33,658 INFO [Listener at jenkins-hbase4.apache.org/38651] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-14 05:14:33,658 INFO [Listener at jenkins-hbase4.apache.org/38651] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-14 05:14:33,658 DEBUG [Listener at jenkins-hbase4.apache.org/38651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7b4bf029 to 127.0.0.1:55310 2023-07-14 05:14:33,658 DEBUG [Listener at jenkins-hbase4.apache.org/38651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 05:14:33,658 DEBUG [Listener at jenkins-hbase4.apache.org/38651] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-14 05:14:33,658 DEBUG [Listener at jenkins-hbase4.apache.org/38651] util.JVMClusterUtil(257): Found active master hash=471849482, stopped=false 2023-07-14 05:14:33,659 DEBUG [Listener at jenkins-hbase4.apache.org/38651] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 05:14:33,659 DEBUG [Listener at jenkins-hbase4.apache.org/38651] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-14 05:14:33,659 INFO [Listener at jenkins-hbase4.apache.org/38651] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,35845,1689311512312 2023-07-14 05:14:33,660 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-14 05:14:33,660 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-14 05:14:33,660 INFO [Listener at jenkins-hbase4.apache.org/38651] procedure2.ProcedureExecutor(629): Stopping 2023-07-14 05:14:33,660 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-14 05:14:33,660 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-14 05:14:33,661 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 05:14:33,661 DEBUG [Listener at jenkins-hbase4.apache.org/38651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x06af1936 to 127.0.0.1:55310 2023-07-14 05:14:33,661 DEBUG [Listener at jenkins-hbase4.apache.org/38651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 05:14:33,661 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 05:14:33,661 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 05:14:33,661 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 05:14:33,661 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 05:14:33,661 INFO [Listener at jenkins-hbase4.apache.org/38651] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,35487,1689311513755' ***** 2023-07-14 05:14:33,662 DEBUG [Listener at jenkins-hbase4.apache.org/38651] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 05:14:33,662 INFO [Listener at jenkins-hbase4.apache.org/38651] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-14 05:14:33,662 INFO [Listener at jenkins-hbase4.apache.org/38651] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,35535,1689311513825' ***** 2023-07-14 05:14:33,662 DEBUG [Listener at jenkins-hbase4.apache.org/38651] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 05:14:33,662 INFO [RS:0;jenkins-hbase4:35487] regionserver.HeapMemoryManager(220): Stopping 2023-07-14 05:14:33,662 INFO [Listener at jenkins-hbase4.apache.org/38651] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-14 05:14:33,662 INFO [Listener at jenkins-hbase4.apache.org/38651] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,43331,1689311513888' ***** 2023-07-14 05:14:33,662 DEBUG [Listener at jenkins-hbase4.apache.org/38651] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 05:14:33,662 INFO [Listener at jenkins-hbase4.apache.org/38651] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-14 05:14:33,662 INFO [RS:0;jenkins-hbase4:35487] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-14 05:14:33,662 INFO [RS:1;jenkins-hbase4:35535] regionserver.HeapMemoryManager(220): Stopping 2023-07-14 05:14:33,663 INFO [RS:2;jenkins-hbase4:43331] regionserver.HeapMemoryManager(220): Stopping 2023-07-14 05:14:33,663 INFO [RS:2;jenkins-hbase4:43331] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-14 05:14:33,663 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-14 05:14:33,662 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-14 05:14:33,663 INFO [RS:2;jenkins-hbase4:43331] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-14 05:14:33,663 INFO [RS:0;jenkins-hbase4:35487] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-14 05:14:33,663 INFO [RS:2;jenkins-hbase4:43331] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:14:33,663 INFO [RS:1;jenkins-hbase4:35535] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-14 05:14:33,663 INFO [RS:1;jenkins-hbase4:35535] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-14 05:14:33,663 INFO [RS:0;jenkins-hbase4:35487] regionserver.HRegionServer(3305): Received CLOSE for 2c094c58ae2cbbe49d97110c24d96ef4 2023-07-14 05:14:33,663 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-14 05:14:33,663 DEBUG [RS:2;jenkins-hbase4:43331] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x03b82b8e to 127.0.0.1:55310 2023-07-14 05:14:33,663 INFO [RS:1;jenkins-hbase4:35535] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:14:33,663 DEBUG [RS:2;jenkins-hbase4:43331] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 05:14:33,664 DEBUG [RS:1;jenkins-hbase4:35535] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x57c3f6f8 to 127.0.0.1:55310 2023-07-14 05:14:33,666 INFO [RS:0;jenkins-hbase4:35487] regionserver.HRegionServer(3305): Received CLOSE for 437edc714ffa0d0a6cb653095eafbdc8 2023-07-14 05:14:33,666 DEBUG [RS:1;jenkins-hbase4:35535] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 05:14:33,666 INFO [RS:2;jenkins-hbase4:43331] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-14 05:14:33,667 INFO [RS:1;jenkins-hbase4:35535] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,35535,1689311513825; all regions closed. 2023-07-14 05:14:33,667 INFO [RS:2;jenkins-hbase4:43331] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-14 05:14:33,667 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2c094c58ae2cbbe49d97110c24d96ef4, disabling compactions & flushes 2023-07-14 05:14:33,666 INFO [RS:0;jenkins-hbase4:35487] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:14:33,667 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689311517584.2c094c58ae2cbbe49d97110c24d96ef4. 2023-07-14 05:14:33,667 INFO [RS:2;jenkins-hbase4:43331] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-14 05:14:33,667 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689311517584.2c094c58ae2cbbe49d97110c24d96ef4. 2023-07-14 05:14:33,667 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689311517584.2c094c58ae2cbbe49d97110c24d96ef4. after waiting 0 ms 2023-07-14 05:14:33,667 INFO [RS:2;jenkins-hbase4:43331] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-14 05:14:33,667 DEBUG [RS:0;jenkins-hbase4:35487] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x46b6217d to 127.0.0.1:55310 2023-07-14 05:14:33,667 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689311517584.2c094c58ae2cbbe49d97110c24d96ef4. 2023-07-14 05:14:33,667 DEBUG [RS:0;jenkins-hbase4:35487] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 05:14:33,667 INFO [RS:2;jenkins-hbase4:43331] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-14 05:14:33,668 INFO [RS:0;jenkins-hbase4:35487] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-14 05:14:33,667 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 2c094c58ae2cbbe49d97110c24d96ef4 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-14 05:14:33,668 DEBUG [RS:2;jenkins-hbase4:43331] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-07-14 05:14:33,668 DEBUG [RS:0;jenkins-hbase4:35487] regionserver.HRegionServer(1478): Online Regions={2c094c58ae2cbbe49d97110c24d96ef4=hbase:acl,,1689311517584.2c094c58ae2cbbe49d97110c24d96ef4., 437edc714ffa0d0a6cb653095eafbdc8=hbase:namespace,,1689311516836.437edc714ffa0d0a6cb653095eafbdc8.} 2023-07-14 05:14:33,668 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-14 05:14:33,669 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-14 05:14:33,669 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-14 05:14:33,669 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-14 05:14:33,669 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-14 05:14:33,669 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-14 05:14:33,670 DEBUG [RS:0;jenkins-hbase4:35487] regionserver.HRegionServer(1504): Waiting on 2c094c58ae2cbbe49d97110c24d96ef4, 437edc714ffa0d0a6cb653095eafbdc8 2023-07-14 05:14:33,670 DEBUG [RS:2;jenkins-hbase4:43331] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-14 05:14:33,676 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-14 05:14:33,678 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-14 05:14:33,696 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-14 05:14:33,703 DEBUG [RS:1;jenkins-hbase4:35535] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/oldWALs 2023-07-14 05:14:33,703 INFO [RS:1;jenkins-hbase4:35535] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35535%2C1689311513825:(num 1689311516146) 2023-07-14 05:14:33,703 DEBUG [RS:1;jenkins-hbase4:35535] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 05:14:33,703 INFO [RS:1;jenkins-hbase4:35535] regionserver.LeaseManager(133): Closed leases 2023-07-14 05:14:33,709 INFO [RS:1;jenkins-hbase4:35535] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-14 05:14:33,712 INFO [RS:1;jenkins-hbase4:35535] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-14 05:14:33,712 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-14 05:14:33,712 INFO [RS:1;jenkins-hbase4:35535] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-14 05:14:33,712 INFO [RS:1;jenkins-hbase4:35535] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-14 05:14:33,715 INFO [RS:1;jenkins-hbase4:35535] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35535 2023-07-14 05:14:33,723 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:14:33,723 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:14:33,723 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 05:14:33,723 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 05:14:33,723 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35535,1689311513825 2023-07-14 05:14:33,723 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 05:14:33,723 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 05:14:33,724 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35535,1689311513825] 2023-07-14 05:14:33,725 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35535,1689311513825; numProcessing=1 2023-07-14 05:14:33,728 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35535,1689311513825 already deleted, retry=false 2023-07-14 05:14:33,728 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35535,1689311513825 expired; onlineServers=2 2023-07-14 05:14:33,826 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 05:14:33,826 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35535-0x101623e86490002, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 05:14:33,826 INFO [RS:1;jenkins-hbase4:35535] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,35535,1689311513825; zookeeper connection closed. 2023-07-14 05:14:33,827 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7cf70a62] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7cf70a62 2023-07-14 05:14:33,870 DEBUG [RS:0;jenkins-hbase4:35487] regionserver.HRegionServer(1504): Waiting on 2c094c58ae2cbbe49d97110c24d96ef4, 437edc714ffa0d0a6cb653095eafbdc8 2023-07-14 05:14:33,870 DEBUG [RS:2;jenkins-hbase4:43331] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-14 05:14:33,955 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-14 05:14:33,955 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-14 05:14:33,974 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-14 05:14:33,974 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-14 05:14:34,070 DEBUG [RS:0;jenkins-hbase4:35487] regionserver.HRegionServer(1504): Waiting on 2c094c58ae2cbbe49d97110c24d96ef4, 437edc714ffa0d0a6cb653095eafbdc8 2023-07-14 05:14:34,070 DEBUG [RS:2;jenkins-hbase4:43331] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-14 05:14:34,118 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/hbase/acl/2c094c58ae2cbbe49d97110c24d96ef4/.tmp/l/d8e4a86e325a4ce2a39b46d752709a47 2023-07-14 05:14:34,119 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/hbase/meta/1588230740/.tmp/info/75a2be95ad55472485b6ca82fae7afd2 2023-07-14 05:14:34,129 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 75a2be95ad55472485b6ca82fae7afd2 2023-07-14 05:14:34,129 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d8e4a86e325a4ce2a39b46d752709a47 2023-07-14 05:14:34,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/hbase/acl/2c094c58ae2cbbe49d97110c24d96ef4/.tmp/l/d8e4a86e325a4ce2a39b46d752709a47 as hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/hbase/acl/2c094c58ae2cbbe49d97110c24d96ef4/l/d8e4a86e325a4ce2a39b46d752709a47 2023-07-14 05:14:34,135 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d8e4a86e325a4ce2a39b46d752709a47 2023-07-14 05:14:34,136 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/hbase/acl/2c094c58ae2cbbe49d97110c24d96ef4/l/d8e4a86e325a4ce2a39b46d752709a47, entries=7, sequenceid=18, filesize=5.2 K 2023-07-14 05:14:34,136 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 2c094c58ae2cbbe49d97110c24d96ef4 in 469ms, sequenceid=18, compaction requested=false 2023-07-14 05:14:34,147 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/hbase/meta/1588230740/.tmp/rep_barrier/c7e80ecbcc3242da80fb53dbcef25482 2023-07-14 05:14:34,148 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/hbase/acl/2c094c58ae2cbbe49d97110c24d96ef4/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-14 05:14:34,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 05:14:34,150 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689311517584.2c094c58ae2cbbe49d97110c24d96ef4. 2023-07-14 05:14:34,150 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2c094c58ae2cbbe49d97110c24d96ef4: 2023-07-14 05:14:34,150 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689311517584.2c094c58ae2cbbe49d97110c24d96ef4. 2023-07-14 05:14:34,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 437edc714ffa0d0a6cb653095eafbdc8, disabling compactions & flushes 2023-07-14 05:14:34,151 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689311516836.437edc714ffa0d0a6cb653095eafbdc8. 2023-07-14 05:14:34,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689311516836.437edc714ffa0d0a6cb653095eafbdc8. 2023-07-14 05:14:34,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689311516836.437edc714ffa0d0a6cb653095eafbdc8. after waiting 0 ms 2023-07-14 05:14:34,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689311516836.437edc714ffa0d0a6cb653095eafbdc8. 2023-07-14 05:14:34,151 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 437edc714ffa0d0a6cb653095eafbdc8 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-14 05:14:34,153 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c7e80ecbcc3242da80fb53dbcef25482 2023-07-14 05:14:34,175 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/hbase/namespace/437edc714ffa0d0a6cb653095eafbdc8/.tmp/info/9975a476350d48939a01f0d9950d1f47 2023-07-14 05:14:34,175 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/hbase/meta/1588230740/.tmp/table/e3332ae5e69b47949db1325ea7674b25 2023-07-14 05:14:34,179 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e3332ae5e69b47949db1325ea7674b25 2023-07-14 05:14:34,180 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/hbase/meta/1588230740/.tmp/info/75a2be95ad55472485b6ca82fae7afd2 as hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/hbase/meta/1588230740/info/75a2be95ad55472485b6ca82fae7afd2 2023-07-14 05:14:34,181 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/hbase/namespace/437edc714ffa0d0a6cb653095eafbdc8/.tmp/info/9975a476350d48939a01f0d9950d1f47 as hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/hbase/namespace/437edc714ffa0d0a6cb653095eafbdc8/info/9975a476350d48939a01f0d9950d1f47 2023-07-14 05:14:34,187 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 75a2be95ad55472485b6ca82fae7afd2 2023-07-14 05:14:34,187 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/hbase/meta/1588230740/info/75a2be95ad55472485b6ca82fae7afd2, entries=48, sequenceid=131, filesize=10.3 K 2023-07-14 05:14:34,188 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/hbase/namespace/437edc714ffa0d0a6cb653095eafbdc8/info/9975a476350d48939a01f0d9950d1f47, entries=2, sequenceid=6, filesize=4.8 K 2023-07-14 05:14:34,189 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/hbase/meta/1588230740/.tmp/rep_barrier/c7e80ecbcc3242da80fb53dbcef25482 as hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/hbase/meta/1588230740/rep_barrier/c7e80ecbcc3242da80fb53dbcef25482 2023-07-14 05:14:34,189 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 437edc714ffa0d0a6cb653095eafbdc8 in 38ms, sequenceid=6, compaction requested=false 2023-07-14 05:14:34,199 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c7e80ecbcc3242da80fb53dbcef25482 2023-07-14 05:14:34,199 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/hbase/meta/1588230740/rep_barrier/c7e80ecbcc3242da80fb53dbcef25482, entries=13, sequenceid=131, filesize=6.4 K 2023-07-14 05:14:34,199 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/hbase/meta/1588230740/.tmp/table/e3332ae5e69b47949db1325ea7674b25 as hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/hbase/meta/1588230740/table/e3332ae5e69b47949db1325ea7674b25 2023-07-14 05:14:34,207 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e3332ae5e69b47949db1325ea7674b25 2023-07-14 05:14:34,207 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/hbase/meta/1588230740/table/e3332ae5e69b47949db1325ea7674b25, entries=24, sequenceid=131, filesize=6.9 K 2023-07-14 05:14:34,208 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 539ms, sequenceid=131, compaction requested=false 2023-07-14 05:14:34,216 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/hbase/namespace/437edc714ffa0d0a6cb653095eafbdc8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 05:14:34,217 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 05:14:34,217 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689311516836.437edc714ffa0d0a6cb653095eafbdc8. 2023-07-14 05:14:34,217 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 437edc714ffa0d0a6cb653095eafbdc8: 2023-07-14 05:14:34,217 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689311516836.437edc714ffa0d0a6cb653095eafbdc8. 2023-07-14 05:14:34,218 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-14 05:14:34,219 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 05:14:34,219 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-14 05:14:34,219 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-14 05:14:34,219 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-14 05:14:34,220 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-14 05:14:34,270 INFO [RS:0;jenkins-hbase4:35487] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,35487,1689311513755; all regions closed. 2023-07-14 05:14:34,271 INFO [RS:2;jenkins-hbase4:43331] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,43331,1689311513888; all regions closed. 2023-07-14 05:14:34,277 DEBUG [RS:0;jenkins-hbase4:35487] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/oldWALs 2023-07-14 05:14:34,278 DEBUG [RS:2;jenkins-hbase4:43331] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/oldWALs 2023-07-14 05:14:34,278 INFO [RS:0;jenkins-hbase4:35487] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35487%2C1689311513755:(num 1689311516157) 2023-07-14 05:14:34,278 INFO [RS:2;jenkins-hbase4:43331] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43331%2C1689311513888.meta:.meta(num 1689311516491) 2023-07-14 05:14:34,278 DEBUG [RS:0;jenkins-hbase4:35487] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 05:14:34,278 INFO [RS:0;jenkins-hbase4:35487] regionserver.LeaseManager(133): Closed leases 2023-07-14 05:14:34,278 INFO [RS:0;jenkins-hbase4:35487] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-14 05:14:34,279 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-14 05:14:34,279 INFO [RS:0;jenkins-hbase4:35487] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-14 05:14:34,279 INFO [RS:0;jenkins-hbase4:35487] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-14 05:14:34,279 INFO [RS:0;jenkins-hbase4:35487] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-14 05:14:34,280 INFO [RS:0;jenkins-hbase4:35487] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35487 2023-07-14 05:14:34,284 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:14:34,284 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35487,1689311513755 2023-07-14 05:14:34,284 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 05:14:34,286 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35487,1689311513755] 2023-07-14 05:14:34,286 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35487,1689311513755; numProcessing=2 2023-07-14 05:14:34,287 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35487,1689311513755 already deleted, retry=false 2023-07-14 05:14:34,287 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35487,1689311513755 expired; onlineServers=1 2023-07-14 05:14:34,287 DEBUG [RS:2;jenkins-hbase4:43331] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/oldWALs 2023-07-14 05:14:34,287 INFO [RS:2;jenkins-hbase4:43331] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43331%2C1689311513888:(num 1689311516154) 2023-07-14 05:14:34,287 DEBUG [RS:2;jenkins-hbase4:43331] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 05:14:34,287 INFO [RS:2;jenkins-hbase4:43331] regionserver.LeaseManager(133): Closed leases 2023-07-14 05:14:34,288 INFO [RS:2;jenkins-hbase4:43331] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-14 05:14:34,288 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-14 05:14:34,289 INFO [RS:2;jenkins-hbase4:43331] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43331 2023-07-14 05:14:34,291 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43331,1689311513888 2023-07-14 05:14:34,291 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 05:14:34,293 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43331,1689311513888] 2023-07-14 05:14:34,293 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43331,1689311513888; numProcessing=3 2023-07-14 05:14:34,294 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43331,1689311513888 already deleted, retry=false 2023-07-14 05:14:34,294 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43331,1689311513888 expired; onlineServers=0 2023-07-14 05:14:34,294 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,35845,1689311512312' ***** 2023-07-14 05:14:34,294 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-14 05:14:34,294 DEBUG [M:0;jenkins-hbase4:35845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d22d031, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-14 05:14:34,294 INFO [M:0;jenkins-hbase4:35845] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,35845,1689311512312 2023-07-14 05:14:34,294 INFO [M:0;jenkins-hbase4:35845] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,35845,1689311512312; all regions closed. 2023-07-14 05:14:34,294 DEBUG [M:0;jenkins-hbase4:35845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 05:14:34,294 DEBUG [M:0;jenkins-hbase4:35845] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-14 05:14:34,295 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-14 05:14:34,295 DEBUG [M:0;jenkins-hbase4:35845] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-14 05:14:34,295 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689311515562] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689311515562,5,FailOnTimeoutGroup] 2023-07-14 05:14:34,295 INFO [M:0;jenkins-hbase4:35845] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-14 05:14:34,295 INFO [M:0;jenkins-hbase4:35845] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-14 05:14:34,295 INFO [M:0;jenkins-hbase4:35845] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-14 05:14:34,295 DEBUG [M:0;jenkins-hbase4:35845] master.HMaster(1512): Stopping service threads 2023-07-14 05:14:34,295 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689311515562] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689311515562,5,FailOnTimeoutGroup] 2023-07-14 05:14:34,295 INFO [M:0;jenkins-hbase4:35845] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-14 05:14:34,296 ERROR [M:0;jenkins-hbase4:35845] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-14 05:14:34,296 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-14 05:14:34,296 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 05:14:34,296 INFO [M:0;jenkins-hbase4:35845] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-14 05:14:34,296 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-14 05:14:34,297 DEBUG [M:0;jenkins-hbase4:35845] zookeeper.ZKUtil(398): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-14 05:14:34,297 WARN [M:0;jenkins-hbase4:35845] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-14 05:14:34,297 INFO [M:0;jenkins-hbase4:35845] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-14 05:14:34,297 INFO [M:0;jenkins-hbase4:35845] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-14 05:14:34,298 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-14 05:14:34,299 DEBUG [M:0;jenkins-hbase4:35845] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-14 05:14:34,299 INFO [M:0;jenkins-hbase4:35845] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 05:14:34,299 DEBUG [M:0;jenkins-hbase4:35845] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 05:14:34,299 DEBUG [M:0;jenkins-hbase4:35845] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-14 05:14:34,299 DEBUG [M:0;jenkins-hbase4:35845] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 05:14:34,299 INFO [M:0;jenkins-hbase4:35845] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=373.40 KB heapSize=449.60 KB 2023-07-14 05:14:34,315 INFO [M:0;jenkins-hbase4:35845] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=373.40 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/88d2c14b0c1445c38476c6611d3a1447 2023-07-14 05:14:34,319 INFO [M:0;jenkins-hbase4:35845] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 88d2c14b0c1445c38476c6611d3a1447 2023-07-14 05:14:34,320 DEBUG [M:0;jenkins-hbase4:35845] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/88d2c14b0c1445c38476c6611d3a1447 as hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/88d2c14b0c1445c38476c6611d3a1447 2023-07-14 05:14:34,325 INFO [M:0;jenkins-hbase4:35845] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 88d2c14b0c1445c38476c6611d3a1447 2023-07-14 05:14:34,325 INFO [M:0;jenkins-hbase4:35845] regionserver.HStore(1080): Added hdfs://localhost:36535/user/jenkins/test-data/c614521c-4e6b-7f5a-6db5-c4c92964cf48/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/88d2c14b0c1445c38476c6611d3a1447, entries=119, sequenceid=899, filesize=28.5 K 2023-07-14 05:14:34,326 INFO [M:0;jenkins-hbase4:35845] regionserver.HRegion(2948): Finished flush of dataSize ~373.40 KB/382364, heapSize ~449.59 KB/460376, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 27ms, sequenceid=899, compaction requested=false 2023-07-14 05:14:34,331 INFO [M:0;jenkins-hbase4:35845] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 05:14:34,331 DEBUG [M:0;jenkins-hbase4:35845] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-14 05:14:34,334 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-14 05:14:34,334 INFO [M:0;jenkins-hbase4:35845] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-14 05:14:34,335 INFO [M:0;jenkins-hbase4:35845] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35845 2023-07-14 05:14:34,337 DEBUG [M:0;jenkins-hbase4:35845] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,35845,1689311512312 already deleted, retry=false 2023-07-14 05:14:34,387 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 05:14:34,387 INFO [RS:0;jenkins-hbase4:35487] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,35487,1689311513755; zookeeper connection closed. 2023-07-14 05:14:34,387 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:35487-0x101623e86490001, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 05:14:34,387 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@54d8d7bc] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@54d8d7bc 2023-07-14 05:14:34,487 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 05:14:34,487 INFO [M:0;jenkins-hbase4:35845] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,35845,1689311512312; zookeeper connection closed. 2023-07-14 05:14:34,487 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): master:35845-0x101623e86490000, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 05:14:34,587 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 05:14:34,587 INFO [RS:2;jenkins-hbase4:43331] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,43331,1689311513888; zookeeper connection closed. 2023-07-14 05:14:34,587 DEBUG [Listener at localhost/35767-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x101623e86490003, quorum=127.0.0.1:55310, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 05:14:34,588 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@263a25] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@263a25 2023-07-14 05:14:34,588 INFO [Listener at jenkins-hbase4.apache.org/38651] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-14 05:14:34,588 WARN [Listener at jenkins-hbase4.apache.org/38651] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-14 05:14:34,594 INFO [Listener at jenkins-hbase4.apache.org/38651] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-14 05:14:34,701 WARN [BP-983017206-172.31.14.131-1689311508345 heartbeating to localhost/127.0.0.1:36535] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-14 05:14:34,701 WARN [BP-983017206-172.31.14.131-1689311508345 heartbeating to localhost/127.0.0.1:36535] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-983017206-172.31.14.131-1689311508345 (Datanode Uuid fdccf12e-6cf3-41e9-9102-3af0f83ade5d) service to localhost/127.0.0.1:36535 2023-07-14 05:14:34,703 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/cluster_0a5de1ae-f170-3a29-48d6-c867fdd6855b/dfs/data/data5/current/BP-983017206-172.31.14.131-1689311508345] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-14 05:14:34,703 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/cluster_0a5de1ae-f170-3a29-48d6-c867fdd6855b/dfs/data/data6/current/BP-983017206-172.31.14.131-1689311508345] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-14 05:14:34,705 WARN [Listener at jenkins-hbase4.apache.org/38651] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-14 05:14:34,713 INFO [Listener at jenkins-hbase4.apache.org/38651] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-14 05:14:34,717 WARN [BP-983017206-172.31.14.131-1689311508345 heartbeating to localhost/127.0.0.1:36535] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-14 05:14:34,718 WARN [BP-983017206-172.31.14.131-1689311508345 heartbeating to localhost/127.0.0.1:36535] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-983017206-172.31.14.131-1689311508345 (Datanode Uuid 3bfc0b14-bb08-4aac-b8b5-359e3c247c4a) service to localhost/127.0.0.1:36535 2023-07-14 05:14:34,719 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/cluster_0a5de1ae-f170-3a29-48d6-c867fdd6855b/dfs/data/data3/current/BP-983017206-172.31.14.131-1689311508345] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-14 05:14:34,720 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/cluster_0a5de1ae-f170-3a29-48d6-c867fdd6855b/dfs/data/data4/current/BP-983017206-172.31.14.131-1689311508345] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-14 05:14:34,720 WARN [Listener at jenkins-hbase4.apache.org/38651] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-14 05:14:34,732 INFO [Listener at jenkins-hbase4.apache.org/38651] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-14 05:14:34,835 WARN [BP-983017206-172.31.14.131-1689311508345 heartbeating to localhost/127.0.0.1:36535] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-14 05:14:34,835 WARN [BP-983017206-172.31.14.131-1689311508345 heartbeating to localhost/127.0.0.1:36535] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-983017206-172.31.14.131-1689311508345 (Datanode Uuid fce7a1c9-fe66-400a-8ffd-c522b3de3f8d) service to localhost/127.0.0.1:36535 2023-07-14 05:14:34,837 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/cluster_0a5de1ae-f170-3a29-48d6-c867fdd6855b/dfs/data/data1/current/BP-983017206-172.31.14.131-1689311508345] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-14 05:14:34,837 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2b46db-8190-722f-cf59-84e3d9f57fbd/cluster_0a5de1ae-f170-3a29-48d6-c867fdd6855b/dfs/data/data2/current/BP-983017206-172.31.14.131-1689311508345] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-14 05:14:34,866 INFO [Listener at jenkins-hbase4.apache.org/38651] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-14 05:14:34,918 INFO [Listener at jenkins-hbase4.apache.org/38651] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-14 05:14:35,034 INFO [Listener at jenkins-hbase4.apache.org/38651] hbase.HBaseTestingUtility(1293): Minicluster is down