2023-07-12 08:13:58,895 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-12 08:13:59,162 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64 2023-07-12 08:13:59,163 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot timeout: 13 mins 2023-07-12 08:13:59,206 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-12 08:13:59,512 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-12 08:13:59,512 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/cluster_1daca596-97fc-0b49-6883-d88e991fb0ab, deleteOnExit=true 2023-07-12 08:13:59,513 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-12 08:13:59,513 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/test.cache.data in system properties and HBase conf 2023-07-12 08:13:59,514 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/hadoop.tmp.dir in system properties and HBase conf 2023-07-12 08:13:59,514 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/hadoop.log.dir in system properties and HBase conf 2023-07-12 08:13:59,515 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-12 08:13:59,516 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-12 08:13:59,516 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-12 08:13:59,935 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-12 08:13:59,940 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-12 08:13:59,941 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-12 08:13:59,941 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-12 08:13:59,941 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 08:13:59,942 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-12 08:13:59,942 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-12 08:13:59,942 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 08:13:59,943 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 08:13:59,943 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-12 08:13:59,944 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/nfs.dump.dir in system properties and HBase conf 2023-07-12 08:13:59,944 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/java.io.tmpdir in system properties and HBase conf 2023-07-12 08:13:59,944 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 08:13:59,945 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-12 08:13:59,945 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-12 08:14:00,586 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-12 08:14:00,591 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-12 08:14:00,936 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-12 08:14:01,164 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-12 08:14:01,184 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 08:14:01,254 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 08:14:01,303 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/java.io.tmpdir/Jetty_localhost_40441_hdfs____oun1pb/webapp 2023-07-12 08:14:01,497 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40441 2023-07-12 08:14:01,509 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-12 08:14:01,510 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-12 08:14:02,027 WARN [Listener at localhost/34597] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 08:14:02,115 WARN [Listener at localhost/34597] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 08:14:02,141 WARN [Listener at localhost/34597] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 08:14:02,193 INFO [Listener at localhost/34597] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 08:14:02,202 INFO [Listener at localhost/34597] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/java.io.tmpdir/Jetty_localhost_42159_datanode____6qmuv2/webapp 2023-07-12 08:14:02,369 INFO [Listener at localhost/34597] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42159 2023-07-12 08:14:03,029 WARN [Listener at localhost/38347] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 08:14:03,088 WARN [Listener at localhost/38347] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 08:14:03,095 WARN [Listener at localhost/38347] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 08:14:03,096 INFO [Listener at localhost/38347] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 08:14:03,111 INFO [Listener at localhost/38347] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/java.io.tmpdir/Jetty_localhost_33203_datanode____qhh30/webapp 2023-07-12 08:14:03,254 INFO [Listener at localhost/38347] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33203 2023-07-12 08:14:03,282 WARN [Listener at localhost/38851] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 08:14:03,328 WARN [Listener at localhost/38851] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 08:14:03,338 WARN [Listener at localhost/38851] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 08:14:03,341 INFO [Listener at localhost/38851] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 08:14:03,352 INFO [Listener at localhost/38851] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/java.io.tmpdir/Jetty_localhost_40643_datanode____.rbw6sg/webapp 2023-07-12 08:14:03,494 INFO [Listener at localhost/38851] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40643 2023-07-12 08:14:03,510 WARN [Listener at localhost/46217] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 08:14:03,852 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1069e4539b08fe38: Processing first storage report for DS-bf59fd9c-6af8-4ec6-93cb-9012f7c31987 from datanode c70d66d5-ffa2-4212-acb5-f5be10ddec4a 2023-07-12 08:14:03,854 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1069e4539b08fe38: from storage DS-bf59fd9c-6af8-4ec6-93cb-9012f7c31987 node DatanodeRegistration(127.0.0.1:43649, datanodeUuid=c70d66d5-ffa2-4212-acb5-f5be10ddec4a, infoPort=33585, infoSecurePort=0, ipcPort=38851, storageInfo=lv=-57;cid=testClusterID;nsid=1417024849;c=1689149640677), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-12 08:14:03,855 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x88aacecc4afdcae1: Processing first storage report for DS-aaaac01a-1428-4099-bb70-a546ae56e44e from datanode 08b43db0-c6f6-48a1-a024-40dd6a072085 2023-07-12 08:14:03,855 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x88aacecc4afdcae1: from storage DS-aaaac01a-1428-4099-bb70-a546ae56e44e node DatanodeRegistration(127.0.0.1:45921, datanodeUuid=08b43db0-c6f6-48a1-a024-40dd6a072085, infoPort=35349, infoSecurePort=0, ipcPort=38347, storageInfo=lv=-57;cid=testClusterID;nsid=1417024849;c=1689149640677), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 08:14:03,855 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc79182b04189c3fe: Processing first storage report for DS-33441f8f-6420-472c-9651-a0467254c6b8 from datanode 4d216d80-2690-4120-b321-e4433ee1727e 2023-07-12 08:14:03,855 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc79182b04189c3fe: from storage DS-33441f8f-6420-472c-9651-a0467254c6b8 node DatanodeRegistration(127.0.0.1:34133, datanodeUuid=4d216d80-2690-4120-b321-e4433ee1727e, infoPort=40409, infoSecurePort=0, ipcPort=46217, storageInfo=lv=-57;cid=testClusterID;nsid=1417024849;c=1689149640677), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 08:14:03,856 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1069e4539b08fe38: Processing first storage report for DS-e74298b0-d5fe-4da9-9bd1-2100ee7b0211 from datanode c70d66d5-ffa2-4212-acb5-f5be10ddec4a 2023-07-12 08:14:03,856 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1069e4539b08fe38: from storage DS-e74298b0-d5fe-4da9-9bd1-2100ee7b0211 node DatanodeRegistration(127.0.0.1:43649, datanodeUuid=c70d66d5-ffa2-4212-acb5-f5be10ddec4a, infoPort=33585, infoSecurePort=0, ipcPort=38851, storageInfo=lv=-57;cid=testClusterID;nsid=1417024849;c=1689149640677), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 08:14:03,856 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x88aacecc4afdcae1: Processing first storage report for DS-68544409-8b2d-467d-99cb-c5d8e9492efe from datanode 08b43db0-c6f6-48a1-a024-40dd6a072085 2023-07-12 08:14:03,856 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x88aacecc4afdcae1: from storage DS-68544409-8b2d-467d-99cb-c5d8e9492efe node DatanodeRegistration(127.0.0.1:45921, datanodeUuid=08b43db0-c6f6-48a1-a024-40dd6a072085, infoPort=35349, infoSecurePort=0, ipcPort=38347, storageInfo=lv=-57;cid=testClusterID;nsid=1417024849;c=1689149640677), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 08:14:03,856 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc79182b04189c3fe: Processing first storage report for DS-98f79f7f-0eef-49f9-980b-7680f23e3d26 from datanode 4d216d80-2690-4120-b321-e4433ee1727e 2023-07-12 08:14:03,857 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc79182b04189c3fe: from storage DS-98f79f7f-0eef-49f9-980b-7680f23e3d26 node DatanodeRegistration(127.0.0.1:34133, datanodeUuid=4d216d80-2690-4120-b321-e4433ee1727e, infoPort=40409, infoSecurePort=0, ipcPort=46217, storageInfo=lv=-57;cid=testClusterID;nsid=1417024849;c=1689149640677), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-12 08:14:04,113 DEBUG [Listener at localhost/46217] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64 2023-07-12 08:14:04,201 INFO [Listener at localhost/46217] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/cluster_1daca596-97fc-0b49-6883-d88e991fb0ab/zookeeper_0, clientPort=54842, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/cluster_1daca596-97fc-0b49-6883-d88e991fb0ab/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/cluster_1daca596-97fc-0b49-6883-d88e991fb0ab/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-12 08:14:04,233 INFO [Listener at localhost/46217] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=54842 2023-07-12 08:14:04,245 INFO [Listener at localhost/46217] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 08:14:04,248 INFO [Listener at localhost/46217] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 08:14:04,992 INFO [Listener at localhost/46217] util.FSUtils(471): Created version file at hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4 with version=8 2023-07-12 08:14:04,992 INFO [Listener at localhost/46217] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/hbase-staging 2023-07-12 08:14:05,383 INFO [Listener at localhost/46217] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-12 08:14:06,009 INFO [Listener at localhost/46217] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-12 08:14:06,054 INFO [Listener at localhost/46217] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 08:14:06,054 INFO [Listener at localhost/46217] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 08:14:06,055 INFO [Listener at localhost/46217] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 08:14:06,055 INFO [Listener at localhost/46217] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 08:14:06,055 INFO [Listener at localhost/46217] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 08:14:06,217 INFO [Listener at localhost/46217] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 08:14:06,296 DEBUG [Listener at localhost/46217] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-12 08:14:06,412 INFO [Listener at localhost/46217] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33919 2023-07-12 08:14:06,432 INFO [Listener at localhost/46217] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 08:14:06,434 INFO [Listener at localhost/46217] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 08:14:06,466 INFO [Listener at localhost/46217] zookeeper.RecoverableZooKeeper(93): Process identifier=master:33919 connecting to ZooKeeper ensemble=127.0.0.1:54842 2023-07-12 08:14:06,546 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:339190x0, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 08:14:06,561 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:33919-0x1015898a0960000 connected 2023-07-12 08:14:06,603 DEBUG [Listener at localhost/46217] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 08:14:06,604 DEBUG [Listener at localhost/46217] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 08:14:06,618 DEBUG [Listener at localhost/46217] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 08:14:06,631 DEBUG [Listener at localhost/46217] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33919 2023-07-12 08:14:06,631 DEBUG [Listener at localhost/46217] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33919 2023-07-12 08:14:06,631 DEBUG [Listener at localhost/46217] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33919 2023-07-12 08:14:06,635 DEBUG [Listener at localhost/46217] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33919 2023-07-12 08:14:06,635 DEBUG [Listener at localhost/46217] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33919 2023-07-12 08:14:06,642 INFO [Listener at localhost/46217] master.HMaster(444): hbase.rootdir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4, hbase.cluster.distributed=false 2023-07-12 08:14:06,718 INFO [Listener at localhost/46217] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-12 08:14:06,719 INFO [Listener at localhost/46217] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 08:14:06,719 INFO [Listener at localhost/46217] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 08:14:06,719 INFO [Listener at localhost/46217] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 08:14:06,719 INFO [Listener at localhost/46217] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 08:14:06,720 INFO [Listener at localhost/46217] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 08:14:06,726 INFO [Listener at localhost/46217] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 08:14:06,730 INFO [Listener at localhost/46217] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43719 2023-07-12 08:14:06,733 INFO [Listener at localhost/46217] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 08:14:06,750 DEBUG [Listener at localhost/46217] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-12 08:14:06,751 INFO [Listener at localhost/46217] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 08:14:06,753 INFO [Listener at localhost/46217] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 08:14:06,755 INFO [Listener at localhost/46217] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43719 connecting to ZooKeeper ensemble=127.0.0.1:54842 2023-07-12 08:14:06,762 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:437190x0, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 08:14:06,764 DEBUG [Listener at localhost/46217] zookeeper.ZKUtil(164): regionserver:437190x0, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 08:14:06,765 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:43719-0x1015898a0960001 connected 2023-07-12 08:14:06,767 DEBUG [Listener at localhost/46217] zookeeper.ZKUtil(164): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 08:14:06,769 DEBUG [Listener at localhost/46217] zookeeper.ZKUtil(164): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 08:14:06,769 DEBUG [Listener at localhost/46217] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43719 2023-07-12 08:14:06,770 DEBUG [Listener at localhost/46217] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43719 2023-07-12 08:14:06,770 DEBUG [Listener at localhost/46217] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43719 2023-07-12 08:14:06,814 DEBUG [Listener at localhost/46217] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43719 2023-07-12 08:14:06,820 DEBUG [Listener at localhost/46217] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43719 2023-07-12 08:14:06,834 INFO [Listener at localhost/46217] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-12 08:14:06,834 INFO [Listener at localhost/46217] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 08:14:06,834 INFO [Listener at localhost/46217] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 08:14:06,835 INFO [Listener at localhost/46217] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 08:14:06,835 INFO [Listener at localhost/46217] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 08:14:06,836 INFO [Listener at localhost/46217] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 08:14:06,836 INFO [Listener at localhost/46217] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 08:14:06,842 INFO [Listener at localhost/46217] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43131 2023-07-12 08:14:06,842 INFO [Listener at localhost/46217] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 08:14:06,853 DEBUG [Listener at localhost/46217] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-12 08:14:06,854 INFO [Listener at localhost/46217] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 08:14:06,857 INFO [Listener at localhost/46217] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 08:14:06,861 INFO [Listener at localhost/46217] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43131 connecting to ZooKeeper ensemble=127.0.0.1:54842 2023-07-12 08:14:06,869 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:431310x0, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 08:14:06,870 DEBUG [Listener at localhost/46217] zookeeper.ZKUtil(164): regionserver:431310x0, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 08:14:06,870 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:43131-0x1015898a0960002 connected 2023-07-12 08:14:06,871 DEBUG [Listener at localhost/46217] zookeeper.ZKUtil(164): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 08:14:06,872 DEBUG [Listener at localhost/46217] zookeeper.ZKUtil(164): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 08:14:06,879 DEBUG [Listener at localhost/46217] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43131 2023-07-12 08:14:06,882 DEBUG [Listener at localhost/46217] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43131 2023-07-12 08:14:06,883 DEBUG [Listener at localhost/46217] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43131 2023-07-12 08:14:06,884 DEBUG [Listener at localhost/46217] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43131 2023-07-12 08:14:06,886 DEBUG [Listener at localhost/46217] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43131 2023-07-12 08:14:06,905 INFO [Listener at localhost/46217] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-12 08:14:06,905 INFO [Listener at localhost/46217] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 08:14:06,905 INFO [Listener at localhost/46217] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 08:14:06,906 INFO [Listener at localhost/46217] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 08:14:06,906 INFO [Listener at localhost/46217] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 08:14:06,906 INFO [Listener at localhost/46217] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 08:14:06,906 INFO [Listener at localhost/46217] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 08:14:06,908 INFO [Listener at localhost/46217] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46655 2023-07-12 08:14:06,909 INFO [Listener at localhost/46217] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 08:14:06,911 DEBUG [Listener at localhost/46217] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-12 08:14:06,912 INFO [Listener at localhost/46217] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 08:14:06,914 INFO [Listener at localhost/46217] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 08:14:06,916 INFO [Listener at localhost/46217] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46655 connecting to ZooKeeper ensemble=127.0.0.1:54842 2023-07-12 08:14:06,920 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:466550x0, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 08:14:06,922 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:46655-0x1015898a0960003 connected 2023-07-12 08:14:06,922 DEBUG [Listener at localhost/46217] zookeeper.ZKUtil(164): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 08:14:06,923 DEBUG [Listener at localhost/46217] zookeeper.ZKUtil(164): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 08:14:06,924 DEBUG [Listener at localhost/46217] zookeeper.ZKUtil(164): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 08:14:06,926 DEBUG [Listener at localhost/46217] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46655 2023-07-12 08:14:06,927 DEBUG [Listener at localhost/46217] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46655 2023-07-12 08:14:06,928 DEBUG [Listener at localhost/46217] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46655 2023-07-12 08:14:06,931 DEBUG [Listener at localhost/46217] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46655 2023-07-12 08:14:06,931 DEBUG [Listener at localhost/46217] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46655 2023-07-12 08:14:06,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,33919,1689149645203 2023-07-12 08:14:06,947 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-12 08:14:06,949 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,33919,1689149645203 2023-07-12 08:14:06,971 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 08:14:06,971 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 08:14:06,971 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 08:14:06,971 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 08:14:06,971 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 08:14:06,973 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-12 08:14:06,979 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-12 08:14:06,979 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,33919,1689149645203 from backup master directory 2023-07-12 08:14:06,984 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,33919,1689149645203 2023-07-12 08:14:06,984 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-12 08:14:06,985 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 08:14:06,985 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,33919,1689149645203 2023-07-12 08:14:06,989 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-12 08:14:06,991 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-12 08:14:07,130 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/hbase.id with ID: 1288f45f-0932-4316-9f04-1e651afeb773 2023-07-12 08:14:07,187 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 08:14:07,209 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 08:14:07,292 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x775a92dc to 127.0.0.1:54842 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:14:07,345 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5a0f6be6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:14:07,373 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 08:14:07,375 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-12 08:14:07,393 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-12 08:14:07,393 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-12 08:14:07,395 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-12 08:14:07,400 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-12 08:14:07,402 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 08:14:07,438 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/MasterData/data/master/store-tmp 2023-07-12 08:14:07,503 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:14:07,503 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-12 08:14:07,504 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 08:14:07,504 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 08:14:07,504 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-12 08:14:07,504 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 08:14:07,504 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 08:14:07,504 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 08:14:07,506 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/MasterData/WALs/jenkins-hbase4.apache.org,33919,1689149645203 2023-07-12 08:14:07,537 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33919%2C1689149645203, suffix=, logDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/MasterData/WALs/jenkins-hbase4.apache.org,33919,1689149645203, archiveDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/MasterData/oldWALs, maxLogs=10 2023-07-12 08:14:07,628 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45921,DS-aaaac01a-1428-4099-bb70-a546ae56e44e,DISK] 2023-07-12 08:14:07,628 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34133,DS-33441f8f-6420-472c-9651-a0467254c6b8,DISK] 2023-07-12 08:14:07,628 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43649,DS-bf59fd9c-6af8-4ec6-93cb-9012f7c31987,DISK] 2023-07-12 08:14:07,638 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 08:14:07,717 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/MasterData/WALs/jenkins-hbase4.apache.org,33919,1689149645203/jenkins-hbase4.apache.org%2C33919%2C1689149645203.1689149647554 2023-07-12 08:14:07,718 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45921,DS-aaaac01a-1428-4099-bb70-a546ae56e44e,DISK], DatanodeInfoWithStorage[127.0.0.1:34133,DS-33441f8f-6420-472c-9651-a0467254c6b8,DISK], DatanodeInfoWithStorage[127.0.0.1:43649,DS-bf59fd9c-6af8-4ec6-93cb-9012f7c31987,DISK]] 2023-07-12 08:14:07,719 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-12 08:14:07,719 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:14:07,723 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 08:14:07,724 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 08:14:07,816 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-12 08:14:07,834 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-12 08:14:07,874 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-12 08:14:07,889 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 08:14:07,897 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-12 08:14:07,899 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-12 08:14:07,920 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 08:14:07,930 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 08:14:07,931 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73219445, jitterRate=0.0910547524690628}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 08:14:07,932 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 08:14:07,934 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-12 08:14:07,966 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-12 08:14:07,966 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-12 08:14:07,969 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-12 08:14:07,972 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-12 08:14:08,016 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 43 msec 2023-07-12 08:14:08,016 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-12 08:14:08,050 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-12 08:14:08,058 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-12 08:14:08,084 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-12 08:14:08,089 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-12 08:14:08,091 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-12 08:14:08,097 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-12 08:14:08,101 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-12 08:14:08,104 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 08:14:08,106 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-12 08:14:08,107 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-12 08:14:08,121 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-12 08:14:08,125 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 08:14:08,125 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 08:14:08,125 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 08:14:08,125 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 08:14:08,125 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 08:14:08,127 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,33919,1689149645203, sessionid=0x1015898a0960000, setting cluster-up flag (Was=false) 2023-07-12 08:14:08,144 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 08:14:08,151 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-12 08:14:08,153 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33919,1689149645203 2023-07-12 08:14:08,160 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 08:14:08,166 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-12 08:14:08,168 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33919,1689149645203 2023-07-12 08:14:08,170 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/.tmp 2023-07-12 08:14:08,237 INFO [RS:2;jenkins-hbase4:46655] regionserver.HRegionServer(951): ClusterId : 1288f45f-0932-4316-9f04-1e651afeb773 2023-07-12 08:14:08,238 INFO [RS:0;jenkins-hbase4:43719] regionserver.HRegionServer(951): ClusterId : 1288f45f-0932-4316-9f04-1e651afeb773 2023-07-12 08:14:08,238 INFO [RS:1;jenkins-hbase4:43131] regionserver.HRegionServer(951): ClusterId : 1288f45f-0932-4316-9f04-1e651afeb773 2023-07-12 08:14:08,246 DEBUG [RS:0;jenkins-hbase4:43719] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 08:14:08,248 DEBUG [RS:1;jenkins-hbase4:43131] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 08:14:08,246 DEBUG [RS:2;jenkins-hbase4:46655] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 08:14:08,256 DEBUG [RS:0;jenkins-hbase4:43719] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 08:14:08,256 DEBUG [RS:0;jenkins-hbase4:43719] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 08:14:08,260 DEBUG [RS:2;jenkins-hbase4:46655] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 08:14:08,260 DEBUG [RS:2;jenkins-hbase4:46655] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 08:14:08,262 DEBUG [RS:0;jenkins-hbase4:43719] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 08:14:08,264 DEBUG [RS:0;jenkins-hbase4:43719] zookeeper.ReadOnlyZKClient(139): Connect 0x14d131f2 to 127.0.0.1:54842 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:14:08,265 DEBUG [RS:1;jenkins-hbase4:43131] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 08:14:08,265 DEBUG [RS:1;jenkins-hbase4:43131] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 08:14:08,270 DEBUG [RS:2;jenkins-hbase4:46655] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 08:14:08,271 DEBUG [RS:1;jenkins-hbase4:43131] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 08:14:08,271 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-12 08:14:08,279 DEBUG [RS:2;jenkins-hbase4:46655] zookeeper.ReadOnlyZKClient(139): Connect 0x58fd479a to 127.0.0.1:54842 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:14:08,281 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 08:14:08,281 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-12 08:14:08,288 DEBUG [RS:1;jenkins-hbase4:43131] zookeeper.ReadOnlyZKClient(139): Connect 0x51d36f56 to 127.0.0.1:54842 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:14:08,298 DEBUG [RS:0;jenkins-hbase4:43719] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a16dd18, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:14:08,307 DEBUG [RS:0;jenkins-hbase4:43719] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1e295a82, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-12 08:14:08,329 DEBUG [RS:2;jenkins-hbase4:46655] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@563ab2f5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:14:08,329 DEBUG [RS:2;jenkins-hbase4:46655] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52052cea, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-12 08:14:08,332 DEBUG [RS:1;jenkins-hbase4:43131] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5f148b1c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:14:08,332 DEBUG [RS:1;jenkins-hbase4:43131] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1e298127, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-12 08:14:08,352 DEBUG [RS:2;jenkins-hbase4:46655] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:46655 2023-07-12 08:14:08,354 DEBUG [RS:1;jenkins-hbase4:43131] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:43131 2023-07-12 08:14:08,360 INFO [RS:2;jenkins-hbase4:46655] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 08:14:08,361 INFO [RS:2;jenkins-hbase4:46655] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 08:14:08,361 DEBUG [RS:2;jenkins-hbase4:46655] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-12 08:14:08,361 INFO [RS:1;jenkins-hbase4:43131] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 08:14:08,363 INFO [RS:1;jenkins-hbase4:43131] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 08:14:08,363 DEBUG [RS:1;jenkins-hbase4:43131] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-12 08:14:08,363 INFO [RS:1;jenkins-hbase4:43131] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 08:14:08,364 DEBUG [RS:1;jenkins-hbase4:43131] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 08:14:08,365 INFO [RS:2;jenkins-hbase4:46655] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 08:14:08,365 DEBUG [RS:2;jenkins-hbase4:46655] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 08:14:08,370 INFO [RS:1;jenkins-hbase4:43131] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33919,1689149645203 with isa=jenkins-hbase4.apache.org/172.31.14.131:43131, startcode=1689149646833 2023-07-12 08:14:08,370 DEBUG [RS:0;jenkins-hbase4:43719] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:43719 2023-07-12 08:14:08,370 INFO [RS:0;jenkins-hbase4:43719] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 08:14:08,370 INFO [RS:0;jenkins-hbase4:43719] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 08:14:08,370 DEBUG [RS:0;jenkins-hbase4:43719] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-12 08:14:08,371 INFO [RS:0;jenkins-hbase4:43719] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 08:14:08,371 DEBUG [RS:0;jenkins-hbase4:43719] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 08:14:08,371 INFO [RS:2;jenkins-hbase4:46655] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33919,1689149645203 with isa=jenkins-hbase4.apache.org/172.31.14.131:46655, startcode=1689149646904 2023-07-12 08:14:08,372 INFO [RS:0;jenkins-hbase4:43719] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33919,1689149645203 with isa=jenkins-hbase4.apache.org/172.31.14.131:43719, startcode=1689149646718 2023-07-12 08:14:08,404 DEBUG [RS:1;jenkins-hbase4:43131] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 08:14:08,405 DEBUG [RS:0;jenkins-hbase4:43719] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 08:14:08,405 DEBUG [RS:2;jenkins-hbase4:46655] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 08:14:08,423 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-12 08:14:08,468 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-12 08:14:08,468 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-12 08:14:08,468 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-12 08:14:08,468 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-12 08:14:08,469 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-12 08:14:08,469 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:08,469 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-12 08:14:08,469 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:08,476 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689149678476 2023-07-12 08:14:08,484 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-12 08:14:08,489 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-12 08:14:08,489 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-12 08:14:08,497 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-12 08:14:08,503 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-12 08:14:08,520 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35103, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 08:14:08,521 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-12 08:14:08,530 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-12 08:14:08,531 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-12 08:14:08,531 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-12 08:14:08,535 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-12 08:14:08,520 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54767, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 08:14:08,523 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40827, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 08:14:08,537 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-12 08:14:08,540 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-12 08:14:08,541 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-12 08:14:08,541 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33919] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-12 08:14:08,546 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-12 08:14:08,547 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-12 08:14:08,551 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689149648550,5,FailOnTimeoutGroup] 2023-07-12 08:14:08,559 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689149648551,5,FailOnTimeoutGroup] 2023-07-12 08:14:08,559 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-12 08:14:08,559 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-12 08:14:08,561 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-12 08:14:08,561 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-12 08:14:08,579 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33919] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:08,591 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33919] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:08,600 DEBUG [RS:2;jenkins-hbase4:46655] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4 2023-07-12 08:14:08,600 DEBUG [RS:1;jenkins-hbase4:43131] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4 2023-07-12 08:14:08,600 DEBUG [RS:2;jenkins-hbase4:46655] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:34597 2023-07-12 08:14:08,601 DEBUG [RS:1;jenkins-hbase4:43131] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:34597 2023-07-12 08:14:08,601 DEBUG [RS:1;jenkins-hbase4:43131] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 08:14:08,601 DEBUG [RS:2;jenkins-hbase4:46655] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 08:14:08,605 DEBUG [RS:0;jenkins-hbase4:43719] regionserver.HRegionServer(2830): Master is not running yet 2023-07-12 08:14:08,606 WARN [RS:0;jenkins-hbase4:43719] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-12 08:14:08,617 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 08:14:08,619 DEBUG [RS:2;jenkins-hbase4:46655] zookeeper.ZKUtil(162): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:08,622 DEBUG [RS:1;jenkins-hbase4:43131] zookeeper.ZKUtil(162): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:08,619 WARN [RS:2;jenkins-hbase4:46655] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 08:14:08,623 WARN [RS:1;jenkins-hbase4:43131] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 08:14:08,623 INFO [RS:2;jenkins-hbase4:46655] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 08:14:08,625 DEBUG [RS:2;jenkins-hbase4:46655] regionserver.HRegionServer(1948): logDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/WALs/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:08,623 INFO [RS:1;jenkins-hbase4:43131] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 08:14:08,627 DEBUG [RS:1;jenkins-hbase4:43131] regionserver.HRegionServer(1948): logDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/WALs/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:08,630 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43131,1689149646833] 2023-07-12 08:14:08,630 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46655,1689149646904] 2023-07-12 08:14:08,650 DEBUG [RS:2;jenkins-hbase4:46655] zookeeper.ZKUtil(162): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:08,651 DEBUG [RS:2;jenkins-hbase4:46655] zookeeper.ZKUtil(162): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:08,655 DEBUG [RS:1;jenkins-hbase4:43131] zookeeper.ZKUtil(162): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:08,656 DEBUG [RS:1;jenkins-hbase4:43131] zookeeper.ZKUtil(162): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:08,656 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-12 08:14:08,658 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-12 08:14:08,658 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4 2023-07-12 08:14:08,668 DEBUG [RS:2;jenkins-hbase4:46655] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-12 08:14:08,668 DEBUG [RS:1;jenkins-hbase4:43131] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-12 08:14:08,700 INFO [RS:1;jenkins-hbase4:43131] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 08:14:08,700 INFO [RS:2;jenkins-hbase4:46655] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 08:14:08,707 INFO [RS:0;jenkins-hbase4:43719] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33919,1689149645203 with isa=jenkins-hbase4.apache.org/172.31.14.131:43719, startcode=1689149646718 2023-07-12 08:14:08,708 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33919] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:08,711 DEBUG [RS:0;jenkins-hbase4:43719] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4 2023-07-12 08:14:08,711 DEBUG [RS:0;jenkins-hbase4:43719] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:34597 2023-07-12 08:14:08,711 DEBUG [RS:0;jenkins-hbase4:43719] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 08:14:08,712 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:14:08,713 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 08:14:08,713 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 08:14:08,713 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 08:14:08,714 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43719,1689149646718] 2023-07-12 08:14:08,714 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:08,714 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:08,715 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:08,715 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:08,716 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:08,716 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:08,719 DEBUG [RS:0;jenkins-hbase4:43719] zookeeper.ZKUtil(162): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:08,719 WARN [RS:0;jenkins-hbase4:43719] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 08:14:08,719 INFO [RS:0;jenkins-hbase4:43719] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 08:14:08,719 DEBUG [RS:0;jenkins-hbase4:43719] regionserver.HRegionServer(1948): logDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/WALs/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:08,725 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-12 08:14:08,730 INFO [RS:1;jenkins-hbase4:43131] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 08:14:08,730 INFO [RS:2;jenkins-hbase4:46655] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 08:14:08,731 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/hbase/meta/1588230740/info 2023-07-12 08:14:08,731 DEBUG [RS:0;jenkins-hbase4:43719] zookeeper.ZKUtil(162): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:08,732 DEBUG [RS:0;jenkins-hbase4:43719] zookeeper.ZKUtil(162): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:08,732 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-12 08:14:08,733 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 08:14:08,733 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-12 08:14:08,736 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/hbase/meta/1588230740/rep_barrier 2023-07-12 08:14:08,737 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-12 08:14:08,738 DEBUG [RS:0;jenkins-hbase4:43719] zookeeper.ZKUtil(162): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:08,738 INFO [RS:1;jenkins-hbase4:43131] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 08:14:08,738 INFO [RS:2;jenkins-hbase4:46655] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 08:14:08,739 INFO [RS:1;jenkins-hbase4:43131] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 08:14:08,751 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 08:14:08,762 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-12 08:14:08,746 DEBUG [RS:0;jenkins-hbase4:43719] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-12 08:14:08,763 INFO [RS:0;jenkins-hbase4:43719] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 08:14:08,767 INFO [RS:1;jenkins-hbase4:43131] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 08:14:08,739 INFO [RS:2;jenkins-hbase4:46655] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 08:14:08,769 INFO [RS:2;jenkins-hbase4:46655] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 08:14:08,771 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/hbase/meta/1588230740/table 2023-07-12 08:14:08,772 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-12 08:14:08,773 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 08:14:08,773 INFO [RS:0;jenkins-hbase4:43719] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 08:14:08,788 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/hbase/meta/1588230740 2023-07-12 08:14:08,799 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/hbase/meta/1588230740 2023-07-12 08:14:08,800 INFO [RS:0;jenkins-hbase4:43719] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 08:14:08,800 INFO [RS:0;jenkins-hbase4:43719] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 08:14:08,800 INFO [RS:0;jenkins-hbase4:43719] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 08:14:08,803 INFO [RS:1;jenkins-hbase4:43131] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 08:14:08,803 INFO [RS:2;jenkins-hbase4:46655] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 08:14:08,803 INFO [RS:0;jenkins-hbase4:43719] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 08:14:08,803 DEBUG [RS:1;jenkins-hbase4:43131] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:08,803 DEBUG [RS:2;jenkins-hbase4:46655] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:08,804 DEBUG [RS:1;jenkins-hbase4:43131] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:08,804 DEBUG [RS:0;jenkins-hbase4:43719] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:08,804 DEBUG [RS:1;jenkins-hbase4:43131] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:08,804 DEBUG [RS:0;jenkins-hbase4:43719] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:08,804 DEBUG [RS:1;jenkins-hbase4:43131] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:08,805 DEBUG [RS:0;jenkins-hbase4:43719] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:08,805 DEBUG [RS:1;jenkins-hbase4:43131] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:08,805 DEBUG [RS:0;jenkins-hbase4:43719] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:08,805 DEBUG [RS:1;jenkins-hbase4:43131] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-12 08:14:08,805 DEBUG [RS:0;jenkins-hbase4:43719] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:08,805 DEBUG [RS:1;jenkins-hbase4:43131] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:08,805 DEBUG [RS:0;jenkins-hbase4:43719] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-12 08:14:08,805 DEBUG [RS:1;jenkins-hbase4:43131] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:08,804 DEBUG [RS:2;jenkins-hbase4:46655] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:08,805 DEBUG [RS:1;jenkins-hbase4:43131] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:08,805 DEBUG [RS:2;jenkins-hbase4:46655] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:08,805 DEBUG [RS:1;jenkins-hbase4:43131] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:08,806 DEBUG [RS:2;jenkins-hbase4:46655] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:08,805 DEBUG [RS:0;jenkins-hbase4:43719] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:08,806 DEBUG [RS:2;jenkins-hbase4:46655] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:08,806 DEBUG [RS:0;jenkins-hbase4:43719] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:08,806 DEBUG [RS:2;jenkins-hbase4:46655] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-12 08:14:08,806 DEBUG [RS:0;jenkins-hbase4:43719] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:08,806 DEBUG [RS:2;jenkins-hbase4:46655] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:08,806 DEBUG [RS:0;jenkins-hbase4:43719] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:08,806 DEBUG [RS:2;jenkins-hbase4:46655] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:08,806 DEBUG [RS:2;jenkins-hbase4:46655] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:08,807 DEBUG [RS:2;jenkins-hbase4:46655] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:08,808 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 08:14:08,811 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-12 08:14:08,824 INFO [RS:2;jenkins-hbase4:46655] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 08:14:08,824 INFO [RS:0;jenkins-hbase4:43719] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 08:14:08,824 INFO [RS:2;jenkins-hbase4:46655] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 08:14:08,824 INFO [RS:0;jenkins-hbase4:43719] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 08:14:08,824 INFO [RS:2;jenkins-hbase4:46655] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 08:14:08,824 INFO [RS:1;jenkins-hbase4:43131] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 08:14:08,824 INFO [RS:0;jenkins-hbase4:43719] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 08:14:08,825 INFO [RS:1;jenkins-hbase4:43131] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 08:14:08,825 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 08:14:08,825 INFO [RS:1;jenkins-hbase4:43131] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 08:14:08,826 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61655978, jitterRate=-0.08125433325767517}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 08:14:08,826 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-12 08:14:08,826 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-12 08:14:08,826 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-12 08:14:08,826 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-12 08:14:08,826 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-12 08:14:08,826 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-12 08:14:08,839 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-12 08:14:08,839 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-12 08:14:08,847 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-12 08:14:08,847 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-12 08:14:08,858 INFO [RS:2;jenkins-hbase4:46655] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 08:14:08,861 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-12 08:14:08,870 INFO [RS:2;jenkins-hbase4:46655] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46655,1689149646904-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 08:14:08,874 INFO [RS:0;jenkins-hbase4:43719] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 08:14:08,874 INFO [RS:0;jenkins-hbase4:43719] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43719,1689149646718-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 08:14:08,862 INFO [RS:1;jenkins-hbase4:43131] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 08:14:08,879 INFO [RS:1;jenkins-hbase4:43131] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43131,1689149646833-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 08:14:08,885 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-12 08:14:08,901 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-12 08:14:08,915 INFO [RS:2;jenkins-hbase4:46655] regionserver.Replication(203): jenkins-hbase4.apache.org,46655,1689149646904 started 2023-07-12 08:14:08,915 INFO [RS:0;jenkins-hbase4:43719] regionserver.Replication(203): jenkins-hbase4.apache.org,43719,1689149646718 started 2023-07-12 08:14:08,915 INFO [RS:2;jenkins-hbase4:46655] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,46655,1689149646904, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46655, sessionid=0x1015898a0960003 2023-07-12 08:14:08,915 INFO [RS:0;jenkins-hbase4:43719] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,43719,1689149646718, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43719, sessionid=0x1015898a0960001 2023-07-12 08:14:08,915 DEBUG [RS:2;jenkins-hbase4:46655] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 08:14:08,915 DEBUG [RS:0;jenkins-hbase4:43719] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 08:14:08,915 DEBUG [RS:2;jenkins-hbase4:46655] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:08,915 DEBUG [RS:2;jenkins-hbase4:46655] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46655,1689149646904' 2023-07-12 08:14:08,916 DEBUG [RS:2;jenkins-hbase4:46655] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 08:14:08,915 DEBUG [RS:0;jenkins-hbase4:43719] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:08,916 DEBUG [RS:0;jenkins-hbase4:43719] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43719,1689149646718' 2023-07-12 08:14:08,917 DEBUG [RS:0;jenkins-hbase4:43719] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 08:14:08,918 DEBUG [RS:2;jenkins-hbase4:46655] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 08:14:08,918 DEBUG [RS:0;jenkins-hbase4:43719] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 08:14:08,918 DEBUG [RS:2;jenkins-hbase4:46655] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 08:14:08,919 DEBUG [RS:2;jenkins-hbase4:46655] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 08:14:08,919 DEBUG [RS:2;jenkins-hbase4:46655] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:08,919 DEBUG [RS:2;jenkins-hbase4:46655] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46655,1689149646904' 2023-07-12 08:14:08,919 DEBUG [RS:2;jenkins-hbase4:46655] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:08,919 DEBUG [RS:0;jenkins-hbase4:43719] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 08:14:08,920 DEBUG [RS:2;jenkins-hbase4:46655] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:08,920 DEBUG [RS:0;jenkins-hbase4:43719] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 08:14:08,920 DEBUG [RS:0;jenkins-hbase4:43719] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:08,921 DEBUG [RS:0;jenkins-hbase4:43719] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43719,1689149646718' 2023-07-12 08:14:08,921 DEBUG [RS:0;jenkins-hbase4:43719] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:08,922 DEBUG [RS:0;jenkins-hbase4:43719] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:08,922 DEBUG [RS:0;jenkins-hbase4:43719] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 08:14:08,923 INFO [RS:0;jenkins-hbase4:43719] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 08:14:08,923 INFO [RS:0;jenkins-hbase4:43719] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 08:14:08,925 DEBUG [RS:2;jenkins-hbase4:46655] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 08:14:08,926 INFO [RS:2;jenkins-hbase4:46655] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 08:14:08,926 INFO [RS:2;jenkins-hbase4:46655] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 08:14:08,929 INFO [RS:1;jenkins-hbase4:43131] regionserver.Replication(203): jenkins-hbase4.apache.org,43131,1689149646833 started 2023-07-12 08:14:08,929 INFO [RS:1;jenkins-hbase4:43131] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,43131,1689149646833, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43131, sessionid=0x1015898a0960002 2023-07-12 08:14:08,929 DEBUG [RS:1;jenkins-hbase4:43131] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 08:14:08,929 DEBUG [RS:1;jenkins-hbase4:43131] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:08,929 DEBUG [RS:1;jenkins-hbase4:43131] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43131,1689149646833' 2023-07-12 08:14:08,929 DEBUG [RS:1;jenkins-hbase4:43131] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 08:14:08,930 DEBUG [RS:1;jenkins-hbase4:43131] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 08:14:08,930 DEBUG [RS:1;jenkins-hbase4:43131] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 08:14:08,930 DEBUG [RS:1;jenkins-hbase4:43131] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 08:14:08,930 DEBUG [RS:1;jenkins-hbase4:43131] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:08,930 DEBUG [RS:1;jenkins-hbase4:43131] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43131,1689149646833' 2023-07-12 08:14:08,930 DEBUG [RS:1;jenkins-hbase4:43131] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:08,931 DEBUG [RS:1;jenkins-hbase4:43131] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:08,932 DEBUG [RS:1;jenkins-hbase4:43131] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 08:14:08,932 INFO [RS:1;jenkins-hbase4:43131] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 08:14:08,932 INFO [RS:1;jenkins-hbase4:43131] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 08:14:09,036 INFO [RS:2;jenkins-hbase4:46655] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46655%2C1689149646904, suffix=, logDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/WALs/jenkins-hbase4.apache.org,46655,1689149646904, archiveDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/oldWALs, maxLogs=32 2023-07-12 08:14:09,037 INFO [RS:0;jenkins-hbase4:43719] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43719%2C1689149646718, suffix=, logDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/WALs/jenkins-hbase4.apache.org,43719,1689149646718, archiveDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/oldWALs, maxLogs=32 2023-07-12 08:14:09,037 INFO [RS:1;jenkins-hbase4:43131] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43131%2C1689149646833, suffix=, logDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/WALs/jenkins-hbase4.apache.org,43131,1689149646833, archiveDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/oldWALs, maxLogs=32 2023-07-12 08:14:09,053 DEBUG [jenkins-hbase4:33919] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-12 08:14:09,057 DEBUG [jenkins-hbase4:33919] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 08:14:09,067 DEBUG [jenkins-hbase4:33919] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 08:14:09,067 DEBUG [jenkins-hbase4:33919] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 08:14:09,067 DEBUG [jenkins-hbase4:33919] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 08:14:09,067 DEBUG [jenkins-hbase4:33919] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 08:14:09,086 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43131,1689149646833, state=OPENING 2023-07-12 08:14:09,109 DEBUG [PEWorker-5] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-12 08:14:09,110 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 08:14:09,111 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-12 08:14:09,141 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43131,1689149646833}] 2023-07-12 08:14:09,144 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34133,DS-33441f8f-6420-472c-9651-a0467254c6b8,DISK] 2023-07-12 08:14:09,147 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43649,DS-bf59fd9c-6af8-4ec6-93cb-9012f7c31987,DISK] 2023-07-12 08:14:09,149 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45921,DS-aaaac01a-1428-4099-bb70-a546ae56e44e,DISK] 2023-07-12 08:14:09,156 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45921,DS-aaaac01a-1428-4099-bb70-a546ae56e44e,DISK] 2023-07-12 08:14:09,165 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34133,DS-33441f8f-6420-472c-9651-a0467254c6b8,DISK] 2023-07-12 08:14:09,166 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43649,DS-bf59fd9c-6af8-4ec6-93cb-9012f7c31987,DISK] 2023-07-12 08:14:09,167 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34133,DS-33441f8f-6420-472c-9651-a0467254c6b8,DISK] 2023-07-12 08:14:09,168 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43649,DS-bf59fd9c-6af8-4ec6-93cb-9012f7c31987,DISK] 2023-07-12 08:14:09,170 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45921,DS-aaaac01a-1428-4099-bb70-a546ae56e44e,DISK] 2023-07-12 08:14:09,186 INFO [RS:0;jenkins-hbase4:43719] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/WALs/jenkins-hbase4.apache.org,43719,1689149646718/jenkins-hbase4.apache.org%2C43719%2C1689149646718.1689149649042 2023-07-12 08:14:09,186 INFO [RS:2;jenkins-hbase4:46655] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/WALs/jenkins-hbase4.apache.org,46655,1689149646904/jenkins-hbase4.apache.org%2C46655%2C1689149646904.1689149649042 2023-07-12 08:14:09,187 INFO [RS:1;jenkins-hbase4:43131] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/WALs/jenkins-hbase4.apache.org,43131,1689149646833/jenkins-hbase4.apache.org%2C43131%2C1689149646833.1689149649042 2023-07-12 08:14:09,188 DEBUG [RS:0;jenkins-hbase4:43719] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34133,DS-33441f8f-6420-472c-9651-a0467254c6b8,DISK], DatanodeInfoWithStorage[127.0.0.1:45921,DS-aaaac01a-1428-4099-bb70-a546ae56e44e,DISK], DatanodeInfoWithStorage[127.0.0.1:43649,DS-bf59fd9c-6af8-4ec6-93cb-9012f7c31987,DISK]] 2023-07-12 08:14:09,190 DEBUG [RS:2;jenkins-hbase4:46655] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45921,DS-aaaac01a-1428-4099-bb70-a546ae56e44e,DISK], DatanodeInfoWithStorage[127.0.0.1:43649,DS-bf59fd9c-6af8-4ec6-93cb-9012f7c31987,DISK], DatanodeInfoWithStorage[127.0.0.1:34133,DS-33441f8f-6420-472c-9651-a0467254c6b8,DISK]] 2023-07-12 08:14:09,190 DEBUG [RS:1;jenkins-hbase4:43131] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34133,DS-33441f8f-6420-472c-9651-a0467254c6b8,DISK], DatanodeInfoWithStorage[127.0.0.1:45921,DS-aaaac01a-1428-4099-bb70-a546ae56e44e,DISK], DatanodeInfoWithStorage[127.0.0.1:43649,DS-bf59fd9c-6af8-4ec6-93cb-9012f7c31987,DISK]] 2023-07-12 08:14:09,365 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:09,368 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 08:14:09,374 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41002, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 08:14:09,394 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-12 08:14:09,395 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 08:14:09,399 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43131%2C1689149646833.meta, suffix=.meta, logDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/WALs/jenkins-hbase4.apache.org,43131,1689149646833, archiveDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/oldWALs, maxLogs=32 2023-07-12 08:14:09,422 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34133,DS-33441f8f-6420-472c-9651-a0467254c6b8,DISK] 2023-07-12 08:14:09,435 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45921,DS-aaaac01a-1428-4099-bb70-a546ae56e44e,DISK] 2023-07-12 08:14:09,439 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43649,DS-bf59fd9c-6af8-4ec6-93cb-9012f7c31987,DISK] 2023-07-12 08:14:09,460 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/WALs/jenkins-hbase4.apache.org,43131,1689149646833/jenkins-hbase4.apache.org%2C43131%2C1689149646833.meta.1689149649401.meta 2023-07-12 08:14:09,474 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34133,DS-33441f8f-6420-472c-9651-a0467254c6b8,DISK], DatanodeInfoWithStorage[127.0.0.1:45921,DS-aaaac01a-1428-4099-bb70-a546ae56e44e,DISK], DatanodeInfoWithStorage[127.0.0.1:43649,DS-bf59fd9c-6af8-4ec6-93cb-9012f7c31987,DISK]] 2023-07-12 08:14:09,475 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-12 08:14:09,484 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-12 08:14:09,486 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 08:14:09,487 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-12 08:14:09,490 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-12 08:14:09,493 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-12 08:14:09,513 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-12 08:14:09,514 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:14:09,514 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-12 08:14:09,515 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-12 08:14:09,523 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-12 08:14:09,530 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/hbase/meta/1588230740/info 2023-07-12 08:14:09,533 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/hbase/meta/1588230740/info 2023-07-12 08:14:09,534 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-12 08:14:09,535 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 08:14:09,535 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-12 08:14:09,539 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/hbase/meta/1588230740/rep_barrier 2023-07-12 08:14:09,539 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/hbase/meta/1588230740/rep_barrier 2023-07-12 08:14:09,543 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-12 08:14:09,545 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 08:14:09,545 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-12 08:14:09,549 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/hbase/meta/1588230740/table 2023-07-12 08:14:09,549 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/hbase/meta/1588230740/table 2023-07-12 08:14:09,550 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-12 08:14:09,551 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 08:14:09,553 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/hbase/meta/1588230740 2023-07-12 08:14:09,558 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/hbase/meta/1588230740 2023-07-12 08:14:09,562 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 08:14:09,565 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-12 08:14:09,566 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70020406, jitterRate=0.04338535666465759}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 08:14:09,570 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-12 08:14:09,591 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689149649357 2023-07-12 08:14:09,613 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-12 08:14:09,614 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-12 08:14:09,614 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43131,1689149646833, state=OPEN 2023-07-12 08:14:09,619 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-12 08:14:09,619 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-12 08:14:09,626 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-12 08:14:09,626 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43131,1689149646833 in 478 msec 2023-07-12 08:14:09,637 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-12 08:14:09,637 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 768 msec 2023-07-12 08:14:09,658 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.3550 sec 2023-07-12 08:14:09,660 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689149649658, completionTime=-1 2023-07-12 08:14:09,661 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-12 08:14:09,661 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-12 08:14:09,751 DEBUG [hconnection-0xb137b52-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:14:09,755 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41008, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:14:09,784 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-12 08:14:09,784 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689149709784 2023-07-12 08:14:09,784 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689149769784 2023-07-12 08:14:09,784 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 123 msec 2023-07-12 08:14:09,818 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33919,1689149645203-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 08:14:09,819 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33919,1689149645203-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 08:14:09,819 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33919,1689149645203-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 08:14:09,821 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:33919, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 08:14:09,822 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-12 08:14:09,830 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-12 08:14:09,843 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-12 08:14:09,844 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-12 08:14:09,858 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-12 08:14:09,861 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 08:14:09,865 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 08:14:09,891 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/hbase/namespace/4556439624b5cc6fd5a7f8deec800c71 2023-07-12 08:14:09,893 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/hbase/namespace/4556439624b5cc6fd5a7f8deec800c71 empty. 2023-07-12 08:14:09,894 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/hbase/namespace/4556439624b5cc6fd5a7f8deec800c71 2023-07-12 08:14:09,894 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-12 08:14:09,933 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-12 08:14:09,935 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4556439624b5cc6fd5a7f8deec800c71, NAME => 'hbase:namespace,,1689149649844.4556439624b5cc6fd5a7f8deec800c71.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp 2023-07-12 08:14:09,958 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689149649844.4556439624b5cc6fd5a7f8deec800c71.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:14:09,959 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 4556439624b5cc6fd5a7f8deec800c71, disabling compactions & flushes 2023-07-12 08:14:09,959 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689149649844.4556439624b5cc6fd5a7f8deec800c71. 2023-07-12 08:14:09,959 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689149649844.4556439624b5cc6fd5a7f8deec800c71. 2023-07-12 08:14:09,959 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689149649844.4556439624b5cc6fd5a7f8deec800c71. after waiting 0 ms 2023-07-12 08:14:09,959 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689149649844.4556439624b5cc6fd5a7f8deec800c71. 2023-07-12 08:14:09,960 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689149649844.4556439624b5cc6fd5a7f8deec800c71. 2023-07-12 08:14:09,960 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 4556439624b5cc6fd5a7f8deec800c71: 2023-07-12 08:14:09,969 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 08:14:09,988 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689149649844.4556439624b5cc6fd5a7f8deec800c71.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689149649972"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149649972"}]},"ts":"1689149649972"} 2023-07-12 08:14:10,020 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-12 08:14:10,025 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 08:14:10,030 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149650026"}]},"ts":"1689149650026"} 2023-07-12 08:14:10,035 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-12 08:14:10,044 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 08:14:10,046 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 08:14:10,046 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 08:14:10,046 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 08:14:10,046 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 08:14:10,049 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=4556439624b5cc6fd5a7f8deec800c71, ASSIGN}] 2023-07-12 08:14:10,052 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=4556439624b5cc6fd5a7f8deec800c71, ASSIGN 2023-07-12 08:14:10,054 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=4556439624b5cc6fd5a7f8deec800c71, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46655,1689149646904; forceNewPlan=false, retain=false 2023-07-12 08:14:10,207 INFO [jenkins-hbase4:33919] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-12 08:14:10,208 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=4556439624b5cc6fd5a7f8deec800c71, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:10,209 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689149649844.4556439624b5cc6fd5a7f8deec800c71.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689149650208"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149650208"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149650208"}]},"ts":"1689149650208"} 2023-07-12 08:14:10,214 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 4556439624b5cc6fd5a7f8deec800c71, server=jenkins-hbase4.apache.org,46655,1689149646904}] 2023-07-12 08:14:10,368 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:10,369 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 08:14:10,372 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59464, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 08:14:10,379 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689149649844.4556439624b5cc6fd5a7f8deec800c71. 2023-07-12 08:14:10,379 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4556439624b5cc6fd5a7f8deec800c71, NAME => 'hbase:namespace,,1689149649844.4556439624b5cc6fd5a7f8deec800c71.', STARTKEY => '', ENDKEY => ''} 2023-07-12 08:14:10,379 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689149649844.4556439624b5cc6fd5a7f8deec800c71. service=AccessControlService 2023-07-12 08:14:10,380 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 08:14:10,381 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 4556439624b5cc6fd5a7f8deec800c71 2023-07-12 08:14:10,381 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689149649844.4556439624b5cc6fd5a7f8deec800c71.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:14:10,381 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4556439624b5cc6fd5a7f8deec800c71 2023-07-12 08:14:10,381 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4556439624b5cc6fd5a7f8deec800c71 2023-07-12 08:14:10,383 INFO [StoreOpener-4556439624b5cc6fd5a7f8deec800c71-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 4556439624b5cc6fd5a7f8deec800c71 2023-07-12 08:14:10,385 DEBUG [StoreOpener-4556439624b5cc6fd5a7f8deec800c71-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/hbase/namespace/4556439624b5cc6fd5a7f8deec800c71/info 2023-07-12 08:14:10,386 DEBUG [StoreOpener-4556439624b5cc6fd5a7f8deec800c71-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/hbase/namespace/4556439624b5cc6fd5a7f8deec800c71/info 2023-07-12 08:14:10,386 INFO [StoreOpener-4556439624b5cc6fd5a7f8deec800c71-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4556439624b5cc6fd5a7f8deec800c71 columnFamilyName info 2023-07-12 08:14:10,387 INFO [StoreOpener-4556439624b5cc6fd5a7f8deec800c71-1] regionserver.HStore(310): Store=4556439624b5cc6fd5a7f8deec800c71/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 08:14:10,389 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/hbase/namespace/4556439624b5cc6fd5a7f8deec800c71 2023-07-12 08:14:10,390 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/hbase/namespace/4556439624b5cc6fd5a7f8deec800c71 2023-07-12 08:14:10,396 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4556439624b5cc6fd5a7f8deec800c71 2023-07-12 08:14:10,400 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/hbase/namespace/4556439624b5cc6fd5a7f8deec800c71/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 08:14:10,401 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4556439624b5cc6fd5a7f8deec800c71; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73032995, jitterRate=0.08827643096446991}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 08:14:10,401 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4556439624b5cc6fd5a7f8deec800c71: 2023-07-12 08:14:10,403 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689149649844.4556439624b5cc6fd5a7f8deec800c71., pid=6, masterSystemTime=1689149650368 2023-07-12 08:14:10,407 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689149649844.4556439624b5cc6fd5a7f8deec800c71. 2023-07-12 08:14:10,407 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689149649844.4556439624b5cc6fd5a7f8deec800c71. 2023-07-12 08:14:10,409 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=4556439624b5cc6fd5a7f8deec800c71, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:10,410 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689149649844.4556439624b5cc6fd5a7f8deec800c71.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689149650409"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689149650409"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689149650409"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689149650409"}]},"ts":"1689149650409"} 2023-07-12 08:14:10,417 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-12 08:14:10,417 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 4556439624b5cc6fd5a7f8deec800c71, server=jenkins-hbase4.apache.org,46655,1689149646904 in 200 msec 2023-07-12 08:14:10,421 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-12 08:14:10,421 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=4556439624b5cc6fd5a7f8deec800c71, ASSIGN in 369 msec 2023-07-12 08:14:10,423 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 08:14:10,423 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149650423"}]},"ts":"1689149650423"} 2023-07-12 08:14:10,425 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-12 08:14:10,428 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 08:14:10,432 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 582 msec 2023-07-12 08:14:10,461 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-12 08:14:10,463 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-12 08:14:10,463 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 08:14:10,487 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:14:10,488 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59476, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:14:10,501 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-12 08:14:10,523 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-12 08:14:10,530 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 36 msec 2023-07-12 08:14:10,534 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-12 08:14:10,545 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-12 08:14:10,552 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2023-07-12 08:14:10,561 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-12 08:14:10,564 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-12 08:14:10,567 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.582sec 2023-07-12 08:14:10,571 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-12 08:14:10,573 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-12 08:14:10,573 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-12 08:14:10,574 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33919,1689149645203-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-12 08:14:10,575 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33919,1689149645203-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-12 08:14:10,600 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-12 08:14:10,603 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-12 08:14:10,605 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 08:14:10,608 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 08:14:10,610 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-12 08:14:10,611 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/hbase/acl/4be4e65e0617efa6b1ad96ebdfd8c325 2023-07-12 08:14:10,613 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/hbase/acl/4be4e65e0617efa6b1ad96ebdfd8c325 empty. 2023-07-12 08:14:10,615 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/hbase/acl/4be4e65e0617efa6b1ad96ebdfd8c325 2023-07-12 08:14:10,615 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-12 08:14:10,620 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 08:14:10,641 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-12 08:14:10,644 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4be4e65e0617efa6b1ad96ebdfd8c325, NAME => 'hbase:acl,,1689149650595.4be4e65e0617efa6b1ad96ebdfd8c325.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp 2023-07-12 08:14:10,647 DEBUG [Listener at localhost/46217] zookeeper.ReadOnlyZKClient(139): Connect 0x60c901b5 to 127.0.0.1:54842 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:14:10,660 DEBUG [Listener at localhost/46217] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b401a43, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:14:10,680 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689149650595.4be4e65e0617efa6b1ad96ebdfd8c325.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:14:10,681 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 4be4e65e0617efa6b1ad96ebdfd8c325, disabling compactions & flushes 2023-07-12 08:14:10,681 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689149650595.4be4e65e0617efa6b1ad96ebdfd8c325. 2023-07-12 08:14:10,682 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689149650595.4be4e65e0617efa6b1ad96ebdfd8c325. 2023-07-12 08:14:10,682 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689149650595.4be4e65e0617efa6b1ad96ebdfd8c325. after waiting 0 ms 2023-07-12 08:14:10,682 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689149650595.4be4e65e0617efa6b1ad96ebdfd8c325. 2023-07-12 08:14:10,682 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689149650595.4be4e65e0617efa6b1ad96ebdfd8c325. 2023-07-12 08:14:10,682 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 4be4e65e0617efa6b1ad96ebdfd8c325: 2023-07-12 08:14:10,688 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 08:14:10,690 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689149650595.4be4e65e0617efa6b1ad96ebdfd8c325.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689149650689"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149650689"}]},"ts":"1689149650689"} 2023-07-12 08:14:10,691 DEBUG [hconnection-0x22c1ed3a-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:14:10,693 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-12 08:14:10,695 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 08:14:10,695 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149650695"}]},"ts":"1689149650695"} 2023-07-12 08:14:10,699 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-12 08:14:10,706 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 08:14:10,707 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53028, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:14:10,707 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 08:14:10,707 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 08:14:10,707 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 08:14:10,707 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 08:14:10,708 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=4be4e65e0617efa6b1ad96ebdfd8c325, ASSIGN}] 2023-07-12 08:14:10,710 INFO [Listener at localhost/46217] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,33919,1689149645203 2023-07-12 08:14:10,711 INFO [Listener at localhost/46217] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-12 08:14:10,711 INFO [Listener at localhost/46217] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/test.cache.data in system properties and HBase conf 2023-07-12 08:14:10,711 INFO [Listener at localhost/46217] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/hadoop.tmp.dir in system properties and HBase conf 2023-07-12 08:14:10,711 INFO [Listener at localhost/46217] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/hadoop.log.dir in system properties and HBase conf 2023-07-12 08:14:10,711 INFO [Listener at localhost/46217] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-12 08:14:10,711 INFO [Listener at localhost/46217] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-12 08:14:10,712 INFO [Listener at localhost/46217] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-12 08:14:10,712 INFO [Listener at localhost/46217] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-12 08:14:10,712 INFO [Listener at localhost/46217] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-12 08:14:10,712 INFO [Listener at localhost/46217] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-12 08:14:10,712 INFO [Listener at localhost/46217] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 08:14:10,712 INFO [Listener at localhost/46217] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-12 08:14:10,713 INFO [Listener at localhost/46217] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-12 08:14:10,713 INFO [Listener at localhost/46217] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 08:14:10,713 INFO [Listener at localhost/46217] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 08:14:10,713 INFO [Listener at localhost/46217] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-12 08:14:10,713 INFO [Listener at localhost/46217] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/nfs.dump.dir in system properties and HBase conf 2023-07-12 08:14:10,713 INFO [Listener at localhost/46217] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/java.io.tmpdir in system properties and HBase conf 2023-07-12 08:14:10,713 INFO [Listener at localhost/46217] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 08:14:10,713 INFO [Listener at localhost/46217] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-12 08:14:10,713 INFO [Listener at localhost/46217] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-12 08:14:10,714 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=4be4e65e0617efa6b1ad96ebdfd8c325, ASSIGN 2023-07-12 08:14:10,716 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=4be4e65e0617efa6b1ad96ebdfd8c325, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46655,1689149646904; forceNewPlan=false, retain=false 2023-07-12 08:14:10,724 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 08:14:10,866 INFO [jenkins-hbase4:33919] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-12 08:14:10,868 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=4be4e65e0617efa6b1ad96ebdfd8c325, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:10,868 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689149650595.4be4e65e0617efa6b1ad96ebdfd8c325.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689149650868"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149650868"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149650868"}]},"ts":"1689149650868"} 2023-07-12 08:14:10,872 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 4be4e65e0617efa6b1ad96ebdfd8c325, server=jenkins-hbase4.apache.org,46655,1689149646904}] 2023-07-12 08:14:10,924 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 08:14:11,033 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689149650595.4be4e65e0617efa6b1ad96ebdfd8c325. 2023-07-12 08:14:11,033 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4be4e65e0617efa6b1ad96ebdfd8c325, NAME => 'hbase:acl,,1689149650595.4be4e65e0617efa6b1ad96ebdfd8c325.', STARTKEY => '', ENDKEY => ''} 2023-07-12 08:14:11,034 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689149650595.4be4e65e0617efa6b1ad96ebdfd8c325. service=AccessControlService 2023-07-12 08:14:11,034 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 08:14:11,034 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 4be4e65e0617efa6b1ad96ebdfd8c325 2023-07-12 08:14:11,034 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689149650595.4be4e65e0617efa6b1ad96ebdfd8c325.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:14:11,035 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4be4e65e0617efa6b1ad96ebdfd8c325 2023-07-12 08:14:11,035 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4be4e65e0617efa6b1ad96ebdfd8c325 2023-07-12 08:14:11,039 INFO [StoreOpener-4be4e65e0617efa6b1ad96ebdfd8c325-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 4be4e65e0617efa6b1ad96ebdfd8c325 2023-07-12 08:14:11,041 DEBUG [StoreOpener-4be4e65e0617efa6b1ad96ebdfd8c325-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/hbase/acl/4be4e65e0617efa6b1ad96ebdfd8c325/l 2023-07-12 08:14:11,042 DEBUG [StoreOpener-4be4e65e0617efa6b1ad96ebdfd8c325-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/hbase/acl/4be4e65e0617efa6b1ad96ebdfd8c325/l 2023-07-12 08:14:11,042 INFO [StoreOpener-4be4e65e0617efa6b1ad96ebdfd8c325-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4be4e65e0617efa6b1ad96ebdfd8c325 columnFamilyName l 2023-07-12 08:14:11,044 INFO [StoreOpener-4be4e65e0617efa6b1ad96ebdfd8c325-1] regionserver.HStore(310): Store=4be4e65e0617efa6b1ad96ebdfd8c325/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 08:14:11,047 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/hbase/acl/4be4e65e0617efa6b1ad96ebdfd8c325 2023-07-12 08:14:11,048 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/hbase/acl/4be4e65e0617efa6b1ad96ebdfd8c325 2023-07-12 08:14:11,054 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4be4e65e0617efa6b1ad96ebdfd8c325 2023-07-12 08:14:11,062 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/hbase/acl/4be4e65e0617efa6b1ad96ebdfd8c325/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 08:14:11,063 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4be4e65e0617efa6b1ad96ebdfd8c325; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71801653, jitterRate=0.06992800533771515}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 08:14:11,064 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4be4e65e0617efa6b1ad96ebdfd8c325: 2023-07-12 08:14:11,067 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689149650595.4be4e65e0617efa6b1ad96ebdfd8c325., pid=11, masterSystemTime=1689149651027 2023-07-12 08:14:11,072 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689149650595.4be4e65e0617efa6b1ad96ebdfd8c325. 2023-07-12 08:14:11,073 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689149650595.4be4e65e0617efa6b1ad96ebdfd8c325. 2023-07-12 08:14:11,074 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=4be4e65e0617efa6b1ad96ebdfd8c325, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:11,074 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689149650595.4be4e65e0617efa6b1ad96ebdfd8c325.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689149651073"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689149651073"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689149651073"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689149651073"}]},"ts":"1689149651073"} 2023-07-12 08:14:11,082 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-12 08:14:11,082 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 4be4e65e0617efa6b1ad96ebdfd8c325, server=jenkins-hbase4.apache.org,46655,1689149646904 in 206 msec 2023-07-12 08:14:11,087 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-12 08:14:11,087 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=4be4e65e0617efa6b1ad96ebdfd8c325, ASSIGN in 374 msec 2023-07-12 08:14:11,089 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 08:14:11,089 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149651089"}]},"ts":"1689149651089"} 2023-07-12 08:14:11,093 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-12 08:14:11,101 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 08:14:11,107 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 501 msec 2023-07-12 08:14:11,225 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 08:14:11,225 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-12 08:14:11,254 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-12 08:14:12,256 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 08:14:12,641 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 08:14:12,648 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_33197_jobhistory____.38lenc/webapp 2023-07-12 08:14:12,828 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-12 08:14:12,828 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-12 08:14:12,828 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-12 08:14:12,832 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-12 08:14:12,920 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 08:14:13,279 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 08:14:13,676 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-12 08:14:13,751 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:33197 2023-07-12 08:14:15,072 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 08:14:15,315 WARN [Listener at jenkins-hbase4.apache.org/34711] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 08:14:15,366 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-12 08:14:15,368 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-12 08:14:15,369 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-12 08:14:15,380 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 08:14:15,381 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-12 08:14:15,381 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 08:14:15,381 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-12 08:14:15,381 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-12 08:14:15,382 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-12 08:14:15,382 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 08:14:15,382 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-12 08:14:15,382 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-12 08:14:15,382 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-12 08:14:15,458 WARN [Listener at jenkins-hbase4.apache.org/34711] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-12 08:14:15,459 INFO [Listener at jenkins-hbase4.apache.org/34711] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 08:14:15,478 INFO [Listener at jenkins-hbase4.apache.org/34711] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_39891_cluster____k7y33u/webapp 2023-07-12 08:14:15,575 INFO [Listener at jenkins-hbase4.apache.org/34711] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-12 08:14:15,575 INFO [Listener at jenkins-hbase4.apache.org/34711] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-12 08:14:15,576 INFO [Listener at jenkins-hbase4.apache.org/34711] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-12 08:14:15,576 INFO [Listener at jenkins-hbase4.apache.org/34711] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-12 08:14:15,586 INFO [Listener at jenkins-hbase4.apache.org/34711] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 08:14:15,793 INFO [Listener at jenkins-hbase4.apache.org/34711] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 08:14:15,942 INFO [Listener at jenkins-hbase4.apache.org/34711] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 08:14:15,956 INFO [Listener at jenkins-hbase4.apache.org/34711] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:39891 2023-07-12 08:14:16,582 WARN [Listener at jenkins-hbase4.apache.org/33835] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 08:14:16,614 WARN [Listener at jenkins-hbase4.apache.org/33835] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-12 08:14:16,615 INFO [Listener at jenkins-hbase4.apache.org/33835] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 08:14:16,625 INFO [Listener at jenkins-hbase4.apache.org/33835] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_40009_node____.936zr9/webapp 2023-07-12 08:14:16,687 INFO [Listener at jenkins-hbase4.apache.org/33835] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-12 08:14:16,688 INFO [Listener at jenkins-hbase4.apache.org/33835] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-12 08:14:16,688 INFO [Listener at jenkins-hbase4.apache.org/33835] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-12 08:14:16,688 INFO [Listener at jenkins-hbase4.apache.org/33835] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-12 08:14:16,697 INFO [Listener at jenkins-hbase4.apache.org/33835] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 08:14:16,720 INFO [Listener at jenkins-hbase4.apache.org/33835] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 08:14:16,835 INFO [Listener at jenkins-hbase4.apache.org/33835] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 08:14:16,873 INFO [Listener at jenkins-hbase4.apache.org/33835] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:40009 2023-07-12 08:14:17,194 WARN [Listener at jenkins-hbase4.apache.org/39391] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 08:14:17,203 WARN [Listener at jenkins-hbase4.apache.org/39391] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-12 08:14:17,204 INFO [Listener at jenkins-hbase4.apache.org/39391] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 08:14:17,214 INFO [Listener at jenkins-hbase4.apache.org/39391] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_45801_node____2z3eja/webapp 2023-07-12 08:14:17,277 INFO [Listener at jenkins-hbase4.apache.org/39391] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-12 08:14:17,277 INFO [Listener at jenkins-hbase4.apache.org/39391] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-12 08:14:17,277 INFO [Listener at jenkins-hbase4.apache.org/39391] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-12 08:14:17,278 INFO [Listener at jenkins-hbase4.apache.org/39391] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-12 08:14:17,290 INFO [Listener at jenkins-hbase4.apache.org/39391] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 08:14:17,312 INFO [Listener at jenkins-hbase4.apache.org/39391] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 08:14:17,413 INFO [Listener at jenkins-hbase4.apache.org/39391] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 08:14:17,423 INFO [Listener at jenkins-hbase4.apache.org/39391] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:45801 2023-07-12 08:14:17,483 INFO [Listener at jenkins-hbase4.apache.org/39391] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-12 08:14:17,485 INFO [Listener at jenkins-hbase4.apache.org/39391] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 08:14:17,560 INFO [Listener at jenkins-hbase4.apache.org/39391] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=708, OpenFileDescriptor=896, MaxFileDescriptor=60000, SystemLoadAverage=381, ProcessCount=173, AvailableMemoryMB=5230 2023-07-12 08:14:17,560 WARN [Listener at jenkins-hbase4.apache.org/39391] hbase.ResourceChecker(130): Thread=708 is superior to 500 2023-07-12 08:14:17,576 DEBUG [Listener at jenkins-hbase4.apache.org/39391] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-12 08:14:17,583 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45842, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-12 08:14:17,590 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 08:14:17,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-12 08:14:17,595 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 08:14:17,595 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-12 08:14:17,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 08:14:17,597 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 08:14:17,603 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportWithTargetName/959e006f0c29b3379aa83c208264db76 2023-07-12 08:14:17,603 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportWithTargetName/6fdff36197adb9ea91586f96daf4c308 2023-07-12 08:14:17,605 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportWithTargetName/6fdff36197adb9ea91586f96daf4c308 empty. 2023-07-12 08:14:17,606 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportWithTargetName/959e006f0c29b3379aa83c208264db76 empty. 2023-07-12 08:14:17,607 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportWithTargetName/959e006f0c29b3379aa83c208264db76 2023-07-12 08:14:17,608 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportWithTargetName/6fdff36197adb9ea91586f96daf4c308 2023-07-12 08:14:17,608 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-12 08:14:17,640 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-12 08:14:17,642 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 959e006f0c29b3379aa83c208264db76, NAME => 'testtb-testExportWithTargetName,,1689149657589.959e006f0c29b3379aa83c208264db76.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp 2023-07-12 08:14:17,642 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 6fdff36197adb9ea91586f96daf4c308, NAME => 'testtb-testExportWithTargetName,1,1689149657589.6fdff36197adb9ea91586f96daf4c308.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp 2023-07-12 08:14:17,682 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689149657589.959e006f0c29b3379aa83c208264db76.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:14:17,683 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 959e006f0c29b3379aa83c208264db76, disabling compactions & flushes 2023-07-12 08:14:17,683 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689149657589.959e006f0c29b3379aa83c208264db76. 2023-07-12 08:14:17,683 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689149657589.959e006f0c29b3379aa83c208264db76. 2023-07-12 08:14:17,683 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689149657589.959e006f0c29b3379aa83c208264db76. after waiting 0 ms 2023-07-12 08:14:17,683 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689149657589.959e006f0c29b3379aa83c208264db76. 2023-07-12 08:14:17,683 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689149657589.959e006f0c29b3379aa83c208264db76. 2023-07-12 08:14:17,683 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 959e006f0c29b3379aa83c208264db76: 2023-07-12 08:14:17,691 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689149657589.6fdff36197adb9ea91586f96daf4c308.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:14:17,695 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 6fdff36197adb9ea91586f96daf4c308, disabling compactions & flushes 2023-07-12 08:14:17,695 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689149657589.6fdff36197adb9ea91586f96daf4c308. 2023-07-12 08:14:17,695 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689149657589.6fdff36197adb9ea91586f96daf4c308. 2023-07-12 08:14:17,695 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689149657589.6fdff36197adb9ea91586f96daf4c308. after waiting 0 ms 2023-07-12 08:14:17,696 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689149657589.6fdff36197adb9ea91586f96daf4c308. 2023-07-12 08:14:17,696 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689149657589.6fdff36197adb9ea91586f96daf4c308. 2023-07-12 08:14:17,696 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 6fdff36197adb9ea91586f96daf4c308: 2023-07-12 08:14:17,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 08:14:17,700 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 08:14:17,701 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689149657589.959e006f0c29b3379aa83c208264db76.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689149657701"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149657701"}]},"ts":"1689149657701"} 2023-07-12 08:14:17,701 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689149657589.6fdff36197adb9ea91586f96daf4c308.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689149657701"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149657701"}]},"ts":"1689149657701"} 2023-07-12 08:14:17,752 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 08:14:17,754 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 08:14:17,754 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149657754"}]},"ts":"1689149657754"} 2023-07-12 08:14:17,757 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-12 08:14:17,762 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 08:14:17,764 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 08:14:17,764 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 08:14:17,764 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 08:14:17,764 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 08:14:17,765 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=959e006f0c29b3379aa83c208264db76, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=6fdff36197adb9ea91586f96daf4c308, ASSIGN}] 2023-07-12 08:14:17,770 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=959e006f0c29b3379aa83c208264db76, ASSIGN 2023-07-12 08:14:17,770 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=6fdff36197adb9ea91586f96daf4c308, ASSIGN 2023-07-12 08:14:17,776 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=959e006f0c29b3379aa83c208264db76, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43719,1689149646718; forceNewPlan=false, retain=false 2023-07-12 08:14:17,776 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=6fdff36197adb9ea91586f96daf4c308, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46655,1689149646904; forceNewPlan=false, retain=false 2023-07-12 08:14:17,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 08:14:17,926 INFO [jenkins-hbase4:33919] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 08:14:17,929 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=959e006f0c29b3379aa83c208264db76, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:17,930 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689149657589.959e006f0c29b3379aa83c208264db76.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689149657929"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149657929"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149657929"}]},"ts":"1689149657929"} 2023-07-12 08:14:17,929 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=6fdff36197adb9ea91586f96daf4c308, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:17,931 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689149657589.6fdff36197adb9ea91586f96daf4c308.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689149657929"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149657929"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149657929"}]},"ts":"1689149657929"} 2023-07-12 08:14:17,935 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure 959e006f0c29b3379aa83c208264db76, server=jenkins-hbase4.apache.org,43719,1689149646718}] 2023-07-12 08:14:17,937 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure 6fdff36197adb9ea91586f96daf4c308, server=jenkins-hbase4.apache.org,46655,1689149646904}] 2023-07-12 08:14:18,090 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:18,090 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 08:14:18,093 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43912, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 08:14:18,098 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689149657589.6fdff36197adb9ea91586f96daf4c308. 2023-07-12 08:14:18,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6fdff36197adb9ea91586f96daf4c308, NAME => 'testtb-testExportWithTargetName,1,1689149657589.6fdff36197adb9ea91586f96daf4c308.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 08:14:18,099 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689149657589.959e006f0c29b3379aa83c208264db76. 2023-07-12 08:14:18,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689149657589.6fdff36197adb9ea91586f96daf4c308. service=AccessControlService 2023-07-12 08:14:18,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 959e006f0c29b3379aa83c208264db76, NAME => 'testtb-testExportWithTargetName,,1689149657589.959e006f0c29b3379aa83c208264db76.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 08:14:18,099 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 08:14:18,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689149657589.959e006f0c29b3379aa83c208264db76. service=AccessControlService 2023-07-12 08:14:18,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 6fdff36197adb9ea91586f96daf4c308 2023-07-12 08:14:18,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689149657589.6fdff36197adb9ea91586f96daf4c308.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:14:18,099 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 08:14:18,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6fdff36197adb9ea91586f96daf4c308 2023-07-12 08:14:18,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6fdff36197adb9ea91586f96daf4c308 2023-07-12 08:14:18,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 959e006f0c29b3379aa83c208264db76 2023-07-12 08:14:18,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689149657589.959e006f0c29b3379aa83c208264db76.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:14:18,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 959e006f0c29b3379aa83c208264db76 2023-07-12 08:14:18,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 959e006f0c29b3379aa83c208264db76 2023-07-12 08:14:18,101 INFO [StoreOpener-959e006f0c29b3379aa83c208264db76-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 959e006f0c29b3379aa83c208264db76 2023-07-12 08:14:18,102 INFO [StoreOpener-6fdff36197adb9ea91586f96daf4c308-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6fdff36197adb9ea91586f96daf4c308 2023-07-12 08:14:18,103 DEBUG [StoreOpener-959e006f0c29b3379aa83c208264db76-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportWithTargetName/959e006f0c29b3379aa83c208264db76/cf 2023-07-12 08:14:18,104 DEBUG [StoreOpener-959e006f0c29b3379aa83c208264db76-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportWithTargetName/959e006f0c29b3379aa83c208264db76/cf 2023-07-12 08:14:18,104 INFO [StoreOpener-959e006f0c29b3379aa83c208264db76-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 959e006f0c29b3379aa83c208264db76 columnFamilyName cf 2023-07-12 08:14:18,104 DEBUG [StoreOpener-6fdff36197adb9ea91586f96daf4c308-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportWithTargetName/6fdff36197adb9ea91586f96daf4c308/cf 2023-07-12 08:14:18,104 DEBUG [StoreOpener-6fdff36197adb9ea91586f96daf4c308-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportWithTargetName/6fdff36197adb9ea91586f96daf4c308/cf 2023-07-12 08:14:18,105 INFO [StoreOpener-6fdff36197adb9ea91586f96daf4c308-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6fdff36197adb9ea91586f96daf4c308 columnFamilyName cf 2023-07-12 08:14:18,105 INFO [StoreOpener-959e006f0c29b3379aa83c208264db76-1] regionserver.HStore(310): Store=959e006f0c29b3379aa83c208264db76/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 08:14:18,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportWithTargetName/959e006f0c29b3379aa83c208264db76 2023-07-12 08:14:18,109 INFO [StoreOpener-6fdff36197adb9ea91586f96daf4c308-1] regionserver.HStore(310): Store=6fdff36197adb9ea91586f96daf4c308/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 08:14:18,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportWithTargetName/959e006f0c29b3379aa83c208264db76 2023-07-12 08:14:18,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportWithTargetName/6fdff36197adb9ea91586f96daf4c308 2023-07-12 08:14:18,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportWithTargetName/6fdff36197adb9ea91586f96daf4c308 2023-07-12 08:14:18,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 959e006f0c29b3379aa83c208264db76 2023-07-12 08:14:18,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6fdff36197adb9ea91586f96daf4c308 2023-07-12 08:14:18,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportWithTargetName/959e006f0c29b3379aa83c208264db76/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 08:14:18,124 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 959e006f0c29b3379aa83c208264db76; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61779188, jitterRate=-0.0794183611869812}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 08:14:18,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 959e006f0c29b3379aa83c208264db76: 2023-07-12 08:14:18,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportWithTargetName/6fdff36197adb9ea91586f96daf4c308/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 08:14:18,132 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689149657589.959e006f0c29b3379aa83c208264db76., pid=15, masterSystemTime=1689149658089 2023-07-12 08:14:18,136 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6fdff36197adb9ea91586f96daf4c308; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68558245, jitterRate=0.02159745991230011}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 08:14:18,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6fdff36197adb9ea91586f96daf4c308: 2023-07-12 08:14:18,138 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689149657589.6fdff36197adb9ea91586f96daf4c308., pid=16, masterSystemTime=1689149658091 2023-07-12 08:14:18,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689149657589.959e006f0c29b3379aa83c208264db76. 2023-07-12 08:14:18,139 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689149657589.959e006f0c29b3379aa83c208264db76. 2023-07-12 08:14:18,141 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=959e006f0c29b3379aa83c208264db76, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:18,141 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689149657589.959e006f0c29b3379aa83c208264db76.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689149658141"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689149658141"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689149658141"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689149658141"}]},"ts":"1689149658141"} 2023-07-12 08:14:18,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689149657589.6fdff36197adb9ea91586f96daf4c308. 2023-07-12 08:14:18,141 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689149657589.6fdff36197adb9ea91586f96daf4c308. 2023-07-12 08:14:18,142 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=6fdff36197adb9ea91586f96daf4c308, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:18,146 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689149657589.6fdff36197adb9ea91586f96daf4c308.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689149658142"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689149658142"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689149658142"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689149658142"}]},"ts":"1689149658142"} 2023-07-12 08:14:18,156 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=13 2023-07-12 08:14:18,159 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure 959e006f0c29b3379aa83c208264db76, server=jenkins-hbase4.apache.org,43719,1689149646718 in 216 msec 2023-07-12 08:14:18,160 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=14 2023-07-12 08:14:18,161 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure 6fdff36197adb9ea91586f96daf4c308, server=jenkins-hbase4.apache.org,46655,1689149646904 in 216 msec 2023-07-12 08:14:18,162 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=959e006f0c29b3379aa83c208264db76, ASSIGN in 391 msec 2023-07-12 08:14:18,165 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=12 2023-07-12 08:14:18,165 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=6fdff36197adb9ea91586f96daf4c308, ASSIGN in 396 msec 2023-07-12 08:14:18,167 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 08:14:18,167 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149658167"}]},"ts":"1689149658167"} 2023-07-12 08:14:18,169 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-12 08:14:18,173 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 08:14:18,179 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-12 08:14:18,196 DEBUG [hconnection-0x5fc20074-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:14:18,200 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53044, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=ClientService 2023-07-12 08:14:18,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 08:14:18,212 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46655] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-12 08:14:18,250 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-12 08:14:18,250 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-12 08:14:18,250 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-12 08:14:18,250 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-12 08:14:18,251 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 08:14:18,275 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-12 08:14:18,275 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-12 08:14:18,275 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-12 08:14:18,275 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-12 08:14:18,279 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 685 msec 2023-07-12 08:14:18,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 08:14:18,704 INFO [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-12 08:14:18,705 DEBUG [Listener at jenkins-hbase4.apache.org/39391] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportWithTargetName get assigned. Timeout = 60000ms 2023-07-12 08:14:18,706 INFO [Listener at jenkins-hbase4.apache.org/39391] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 08:14:18,710 INFO [Listener at jenkins-hbase4.apache.org/39391] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportWithTargetName assigned to meta. Checking AM states. 2023-07-12 08:14:18,711 INFO [Listener at jenkins-hbase4.apache.org/39391] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 08:14:18,711 INFO [Listener at jenkins-hbase4.apache.org/39391] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportWithTargetName assigned. 2023-07-12 08:14:18,728 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 08:14:18,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689149658728 (current time:1689149658728). 2023-07-12 08:14:18,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 08:14:18,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] zookeeper.ReadOnlyZKClient(139): Connect 0x2f304465 to 127.0.0.1:54842 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:14:18,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@42d9999d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:14:18,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:14:18,741 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53048, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:14:18,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2f304465 to 127.0.0.1:54842 2023-07-12 08:14:18,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:14:18,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] zookeeper.ReadOnlyZKClient(139): Connect 0x42a18b06 to 127.0.0.1:54842 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:14:18,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24e7d77d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:14:18,848 DEBUG [hconnection-0x179fa204-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:14:18,850 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53062, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:14:18,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:14:18,856 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59488, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:14:18,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x42a18b06 to 127.0.0.1:54842 2023-07-12 08:14:18,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:14:18,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-12 08:14:18,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 08:14:18,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 08:14:18,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 08:14:18,910 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 08:14:18,912 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689150258912 2023-07-12 08:14:18,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 08:14:18,912 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-12 08:14:18,915 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 08:14:18,917 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 08:14:18,917 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 14 msec 2023-07-12 08:14:18,918 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 08:14:18,919 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689150258919 2023-07-12 08:14:18,923 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 08:14:18,923 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 08:14:18,944 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,945 INFO [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-12 08:14:18,945 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:14:18,946 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-12 08:14:18,946 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-12 08:14:18,947 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,947 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,951 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:18,951 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:18,951 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:18,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:18,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:18,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:18,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:18,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:18,951 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:18,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:18,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,952 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:18,952 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:18,953 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,953 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,953 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,953 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:18,953 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 08:14:18,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-12 08:14:18,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-12 08:14:18,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,954 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 08:14:18,954 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 08:14:18,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-12 08:14:18,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,955 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 08:14:18,957 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,957 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,957 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,957 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 08:14:18,957 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:14:18,959 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 08:14:18,959 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-12 08:14:18,959 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 08:14:18,959 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:14:18,959 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43719,1689149646718' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-12 08:14:18,963 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 08:14:18,963 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 08:14:18,963 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-12 08:14:18,964 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:14:18,964 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46655,1689149646904' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-12 08:14:18,965 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 08:14:18,965 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-12 08:14:18,965 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43131,1689149646833' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-12 08:14:18,966 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,966 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:18,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:18,967 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:18,967 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:14:18,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:18,969 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:18,969 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,969 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:18,969 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,970 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:14:18,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:18,971 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,971 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:14:18,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:18,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:18,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:18,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:18,973 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43719,1689149646718' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-12 08:14:18,973 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47f98828[Count = 1] remaining members to acquire global barrier 2023-07-12 08:14:18,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:18,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:18,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:18,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:18,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:18,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:18,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:18,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:18,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:18,977 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46655,1689149646904' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-12 08:14:18,977 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47f98828[Count = 0] remaining members to acquire global barrier 2023-07-12 08:14:18,977 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-12 08:14:18,977 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,979 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,979 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,979 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,979 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:18,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,979 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 08:14:18,980 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 08:14:18,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,980 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:18,980 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 08:14:18,981 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 08:14:18,981 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-12 08:14:18,981 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 08:14:18,981 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43131,1689149646833' in zk 2023-07-12 08:14:18,981 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 08:14:18,981 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689149657589.959e006f0c29b3379aa83c208264db76. 2023-07-12 08:14:18,982 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689149657589.959e006f0c29b3379aa83c208264db76. started... 2023-07-12 08:14:18,986 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 08:14:18,988 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689149657589.6fdff36197adb9ea91586f96daf4c308. 2023-07-12 08:14:18,988 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 08:14:18,988 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689149657589.6fdff36197adb9ea91586f96daf4c308. started... 2023-07-12 08:14:18,988 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 08:14:18,988 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:14:18,988 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-12 08:14:18,991 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6fdff36197adb9ea91586f96daf4c308: 2023-07-12 08:14:18,991 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 959e006f0c29b3379aa83c208264db76: 2023-07-12 08:14:18,992 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689149657589.6fdff36197adb9ea91586f96daf4c308.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,992 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689149657589.959e006f0c29b3379aa83c208264db76.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,998 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 08:14:18,998 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 08:14:19,003 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 08:14:19,003 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 08:14:19,023 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:14:19,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 08:14:19,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-12 08:14:19,029 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 08:14:19,062 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689149657589.959e006f0c29b3379aa83c208264db76. completed. 2023-07-12 08:14:19,062 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689149657589.959e006f0c29b3379aa83c208264db76. 2023-07-12 08:14:19,069 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 08:14:19,069 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 08:14:19,069 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:19,069 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-12 08:14:19,069 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43719,1689149646718' in zk 2023-07-12 08:14:19,071 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689149657589.6fdff36197adb9ea91586f96daf4c308. completed. 2023-07-12 08:14:19,071 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689149657589.6fdff36197adb9ea91586f96daf4c308. 2023-07-12 08:14:19,071 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 08:14:19,071 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 08:14:19,071 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:19,071 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-12 08:14:19,071 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,46655,1689149646904' in zk 2023-07-12 08:14:19,074 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:19,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:19,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:19,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:19,074 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 08:14:19,074 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:14:19,075 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-12 08:14:19,076 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:19,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:19,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:19,077 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 08:14:19,077 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:14:19,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,077 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-12 08:14:19,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:19,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:19,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:19,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:19,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:19,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:19,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:19,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,43719,1689149646718': 2023-07-12 08:14:19,083 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43719,1689149646718' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-12 08:14:19,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:19,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:19,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:19,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:19,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:19,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:19,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:19,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:19,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:19,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:19,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:19,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:19,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,46655,1689149646904': 2023-07-12 08:14:19,092 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46655,1689149646904' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-12 08:14:19,092 INFO [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-12 08:14:19,092 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 08:14:19,092 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 08:14:19,092 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,092 INFO [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 08:14:19,096 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,096 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:19,096 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,096 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,096 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:19,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,096 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:19,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,097 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:19,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:19,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:19,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:19,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:19,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:19,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:19,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:19,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:19,101 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:19,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,101 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:19,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:19,102 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:19,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:19,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:19,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:19,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:19,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,108 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:19,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:19,108 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:19,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:19,109 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:19,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:19,126 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:19,126 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:19,126 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:19,126 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:19,126 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:19,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:19,126 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:14:19,126 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:19,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:19,126 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:19,126 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:19,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:19,127 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:19,127 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:19,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:19,126 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,127 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:19,128 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,128 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:19,128 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,128 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:19,128 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:19,128 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:19,128 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:19,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:19,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:19,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:19,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:19,130 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,183 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,230 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:14:19,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 08:14:19,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-12 08:14:19,232 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 08:14:19,234 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-12 08:14:19,234 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,234 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,235 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689149658912Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689149659128 (+216 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689149659128Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689149659143 (+15 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689149659167 (+24 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689149659234 (+67 ms) 2023-07-12 08:14:19,236 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 08:14:19,238 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 322 msec 2023-07-12 08:14:19,532 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:14:19,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 08:14:19,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 08:14:19,556 DEBUG [htable-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:14:19,565 DEBUG [htable-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:14:19,574 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43918, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:14:19,575 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59494, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:14:19,576 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43719] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689149657589.959e006f0c29b3379aa83c208264db76. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 08:14:19,578 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46655] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689149657589.6fdff36197adb9ea91586f96daf4c308. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 08:14:19,585 DEBUG [Listener at jenkins-hbase4.apache.org/39391] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-12 08:14:19,587 DEBUG [Listener at jenkins-hbase4.apache.org/39391] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689149657589.959e006f0c29b3379aa83c208264db76. 2023-07-12 08:14:19,589 INFO [Listener at jenkins-hbase4.apache.org/39391] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 08:14:19,630 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 08:14:19,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689149659630 (current time:1689149659630). 2023-07-12 08:14:19,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 08:14:19,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] zookeeper.ReadOnlyZKClient(139): Connect 0x6b558cdb to 127.0.0.1:54842 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:14:19,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@58355f72, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:14:19,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:14:19,646 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53064, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:14:19,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6b558cdb to 127.0.0.1:54842 2023-07-12 08:14:19,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:14:19,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] zookeeper.ReadOnlyZKClient(139): Connect 0x09edffca to 127.0.0.1:54842 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:14:19,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e999978, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:14:19,678 DEBUG [hconnection-0x3c259116-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:14:19,683 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53068, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:14:19,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:14:19,690 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59508, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:14:19,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x09edffca to 127.0.0.1:54842 2023-07-12 08:14:19,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:14:19,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-12 08:14:19,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 08:14:19,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 08:14:19,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 08:14:19,698 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 08:14:19,699 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689150259699 2023-07-12 08:14:19,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 08:14:19,700 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-12 08:14:19,702 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 08:14:19,702 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 08:14:19,703 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 08:14:19,704 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 08:14:19,707 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 8 msec 2023-07-12 08:14:19,708 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 08:14:19,710 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689150259710 2023-07-12 08:14:19,736 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-12 08:14:19,736 INFO [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-12 08:14:19,736 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:14:19,738 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-12 08:14:19,738 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-12 08:14:19,739 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 08:14:19,739 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 08:14:19,741 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:19,742 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:19,742 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:19,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:19,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:19,742 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:19,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:19,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:19,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:19,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:19,742 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:19,742 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:19,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 08:14:19,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 08:14:19,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 08:14:19,745 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:19,745 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 08:14:19,745 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 08:14:19,745 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 08:14:19,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-12 08:14:19,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-12 08:14:19,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 08:14:19,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 08:14:19,746 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 08:14:19,746 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 08:14:19,748 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-12 08:14:19,748 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-12 08:14:19,748 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 08:14:19,748 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 08:14:19,748 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:14:19,748 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:14:19,750 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 08:14:19,751 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 08:14:19,751 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-12 08:14:19,751 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 08:14:19,751 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43719,1689149646718' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-12 08:14:19,751 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-12 08:14:19,751 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43131,1689149646833' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-12 08:14:19,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-12 08:14:19,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 08:14:19,753 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 08:14:19,754 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-12 08:14:19,754 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 08:14:19,754 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:14:19,755 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 08:14:19,755 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-12 08:14:19,755 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46655,1689149646904' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-12 08:14:19,756 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 08:14:19,757 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 08:14:19,757 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:19,758 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 08:14:19,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:19,758 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:14:19,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:19,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:19,759 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 08:14:19,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:19,759 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 08:14:19,759 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:14:19,759 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:19,764 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 08:14:19,764 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:14:19,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:19,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 08:14:19,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:19,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:19,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:19,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:19,768 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43719,1689149646718' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-12 08:14:19,768 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2e91cc29[Count = 1] remaining members to acquire global barrier 2023-07-12 08:14:19,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:19,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:19,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:19,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:19,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:19,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 08:14:19,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:19,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:19,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:19,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:19,772 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46655,1689149646904' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-12 08:14:19,772 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2e91cc29[Count = 0] remaining members to acquire global barrier 2023-07-12 08:14:19,772 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-12 08:14:19,772 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 08:14:19,781 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 08:14:19,781 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 08:14:19,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 08:14:19,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 08:14:19,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 08:14:19,781 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 08:14:19,782 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 08:14:19,782 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:19,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 08:14:19,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 08:14:19,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 08:14:19,782 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 08:14:19,782 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 08:14:19,782 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689149657589.959e006f0c29b3379aa83c208264db76. 2023-07-12 08:14:19,782 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 08:14:19,782 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 08:14:19,782 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 08:14:19,782 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 08:14:19,782 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689149657589.6fdff36197adb9ea91586f96daf4c308. 2023-07-12 08:14:19,782 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689149657589.959e006f0c29b3379aa83c208264db76. started... 2023-07-12 08:14:19,782 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:19,783 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689149657589.6fdff36197adb9ea91586f96daf4c308. started... 2023-07-12 08:14:19,783 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-12 08:14:19,783 INFO [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 959e006f0c29b3379aa83c208264db76 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-12 08:14:19,783 INFO [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6fdff36197adb9ea91586f96daf4c308 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-12 08:14:19,783 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 08:14:19,783 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43131,1689149646833' in zk 2023-07-12 08:14:19,787 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 08:14:19,787 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:14:19,787 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-12 08:14:19,802 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:14:19,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 08:14:19,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-12 08:14:19,804 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 08:14:19,921 INFO [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportWithTargetName/6fdff36197adb9ea91586f96daf4c308/.tmp/cf/54de231f04f247d497ba2c172c920175 2023-07-12 08:14:19,921 INFO [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportWithTargetName/959e006f0c29b3379aa83c208264db76/.tmp/cf/b10113afa66d476faa2b5d2a5bef234e 2023-07-12 08:14:19,968 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportWithTargetName/959e006f0c29b3379aa83c208264db76/.tmp/cf/b10113afa66d476faa2b5d2a5bef234e as hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportWithTargetName/959e006f0c29b3379aa83c208264db76/cf/b10113afa66d476faa2b5d2a5bef234e 2023-07-12 08:14:19,968 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportWithTargetName/6fdff36197adb9ea91586f96daf4c308/.tmp/cf/54de231f04f247d497ba2c172c920175 as hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportWithTargetName/6fdff36197adb9ea91586f96daf4c308/cf/54de231f04f247d497ba2c172c920175 2023-07-12 08:14:19,976 INFO [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportWithTargetName/6fdff36197adb9ea91586f96daf4c308/cf/54de231f04f247d497ba2c172c920175, entries=46, sequenceid=6, filesize=7.9 K 2023-07-12 08:14:19,977 INFO [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportWithTargetName/959e006f0c29b3379aa83c208264db76/cf/b10113afa66d476faa2b5d2a5bef234e, entries=4, sequenceid=6, filesize=5.1 K 2023-07-12 08:14:19,981 INFO [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 6fdff36197adb9ea91586f96daf4c308 in 198ms, sequenceid=6, compaction requested=false 2023-07-12 08:14:19,981 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-12 08:14:19,981 INFO [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 959e006f0c29b3379aa83c208264db76 in 198ms, sequenceid=6, compaction requested=false 2023-07-12 08:14:19,981 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-12 08:14:19,983 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6fdff36197adb9ea91586f96daf4c308: 2023-07-12 08:14:19,983 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 959e006f0c29b3379aa83c208264db76: 2023-07-12 08:14:19,984 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689149657589.6fdff36197adb9ea91586f96daf4c308.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-12 08:14:19,984 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689149657589.959e006f0c29b3379aa83c208264db76.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-12 08:14:19,984 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 08:14:19,984 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 08:14:19,984 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportWithTargetName/6fdff36197adb9ea91586f96daf4c308/cf/54de231f04f247d497ba2c172c920175] hfiles 2023-07-12 08:14:19,984 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportWithTargetName/959e006f0c29b3379aa83c208264db76/cf/b10113afa66d476faa2b5d2a5bef234e] hfiles 2023-07-12 08:14:19,984 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportWithTargetName/6fdff36197adb9ea91586f96daf4c308/cf/54de231f04f247d497ba2c172c920175 for snapshot=snaptb0-testExportWithTargetName 2023-07-12 08:14:19,984 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportWithTargetName/959e006f0c29b3379aa83c208264db76/cf/b10113afa66d476faa2b5d2a5bef234e for snapshot=snaptb0-testExportWithTargetName 2023-07-12 08:14:20,011 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:14:20,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 08:14:20,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-12 08:14:20,014 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689149657589.6fdff36197adb9ea91586f96daf4c308. completed. 2023-07-12 08:14:20,015 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689149657589.6fdff36197adb9ea91586f96daf4c308. 2023-07-12 08:14:20,015 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 08:14:20,015 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 08:14:20,015 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 08:14:20,015 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:20,015 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-12 08:14:20,015 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,46655,1689149646904' in zk 2023-07-12 08:14:20,017 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:20,017 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 08:14:20,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:20,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:20,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:20,017 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:14:20,017 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-12 08:14:20,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:20,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:20,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 08:14:20,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:20,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:20,025 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689149657589.959e006f0c29b3379aa83c208264db76. completed. 2023-07-12 08:14:20,025 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689149657589.959e006f0c29b3379aa83c208264db76. 2023-07-12 08:14:20,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:20,025 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 08:14:20,026 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 08:14:20,026 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:20,026 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-12 08:14:20,026 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43719,1689149646718' in zk 2023-07-12 08:14:20,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:20,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 08:14:20,027 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:20,027 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 08:14:20,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:20,028 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:14:20,028 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-12 08:14:20,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:20,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:20,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,46655,1689149646904': 2023-07-12 08:14:20,031 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46655,1689149646904' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-12 08:14:20,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:20,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:20,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:20,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:20,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:20,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 08:14:20,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:20,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:20,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:20,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:20,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 08:14:20,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:20,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:20,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:20,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,43719,1689149646718': 2023-07-12 08:14:20,036 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43719,1689149646718' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-12 08:14:20,036 INFO [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-12 08:14:20,036 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 08:14:20,036 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 08:14:20,036 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-12 08:14:20,036 INFO [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 08:14:20,039 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 08:14:20,039 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 08:14:20,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 08:14:20,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:20,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:20,039 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 08:14:20,039 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 08:14:20,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 08:14:20,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 08:14:20,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 08:14:20,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 08:14:20,039 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:20,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 08:14:20,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 08:14:20,040 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:20,039 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:20,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:20,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:20,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:20,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:20,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:20,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:20,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:20,040 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:20,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 08:14:20,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 08:14:20,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 08:14:20,041 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:20,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 08:14:20,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:20,042 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:20,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 08:14:20,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:20,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:20,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:20,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:20,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 08:14:20,044 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:20,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:20,045 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:20,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:20,045 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:20,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:20,058 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:20,058 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 08:14:20,058 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:20,058 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:20,058 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:20,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:20,059 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:20,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:20,059 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-12 08:14:20,059 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:14:20,059 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:20,059 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:20,058 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:20,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:20,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:20,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:20,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:20,060 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:20,060 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 08:14:20,059 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-12 08:14:20,060 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:20,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:20,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:20,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:20,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:20,060 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 08:14:20,061 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:20,061 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:20,061 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 08:14:20,061 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 08:14:20,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:20,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:20,062 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-12 08:14:20,094 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-12 08:14:20,133 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-12 08:14:20,133 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-12 08:14:20,134 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-12 08:14:20,134 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689149659700Consolidate snapshot: snaptb0-testExportWithTargetName at 1689149660059 (+359 ms)Loading Region manifests for snaptb0-testExportWithTargetName at 1689149660060 (+1 ms)Writing data manifest for snaptb0-testExportWithTargetName at 1689149660065 (+5 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689149660084 (+19 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689149660133 (+49 ms) 2023-07-12 08:14:20,136 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 08:14:20,138 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 435 msec 2023-07-12 08:14:20,315 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:14:20,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 08:14:20,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 08:14:20,319 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/export-test/export-1689149660319 2023-07-12 08:14:20,319 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34597, tgtDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/export-test/export-1689149660319, rawTgtDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/export-test/export-1689149660319, srcFsUri=hdfs://localhost:34597, srcDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4 2023-07-12 08:14:20,375 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34597, inputRoot=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4 2023-07-12 08:14:20,375 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1100677108_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/export-test/export-1689149660319, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/export-test/export-1689149660319/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-12 08:14:20,375 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34597, inputRoot=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4, snapshotDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-12 08:14:20,396 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/export-test/export-1689149660319/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-12 08:14:20,504 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:20,505 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:20,506 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:20,506 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:21,495 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/hadoop-4972037974554010413.jar 2023-07-12 08:14:21,496 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:21,496 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:21,565 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/hadoop-1857940126084496989.jar 2023-07-12 08:14:21,565 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:21,566 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:21,566 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:21,567 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:21,567 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:21,568 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:21,569 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 08:14:21,569 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 08:14:21,570 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 08:14:21,571 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 08:14:21,572 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 08:14:21,573 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 08:14:21,573 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 08:14:21,574 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 08:14:21,574 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 08:14:21,575 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 08:14:21,578 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 08:14:21,579 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 08:14:21,579 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 08:14:21,579 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 08:14:21,579 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 08:14:21,580 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 08:14:21,580 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 08:14:22,589 WARN [Listener at jenkins-hbase4.apache.org/39391] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 08:14:22,597 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-12 08:14:22,608 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-12 08:14:23,202 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 08:14:23,204 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 08:14:23,623 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 08:14:23,644 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656036_0001_000001 (auth:SIMPLE) 2023-07-12 08:14:29,005 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656036_0001_000001 (auth:SIMPLE) 2023-07-12 08:14:31,293 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656036_0001_000001 (auth:SIMPLE) 2023-07-12 08:14:34,095 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656036_0001_000001 (auth:SIMPLE) 2023-07-12 08:14:35,601 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 08:14:35,604 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 08:14:35,614 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-12 08:14:35,614 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 08:14:35,615 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 08:14:35,615 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1077208093_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-12 08:14:35,616 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(367): hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-12 08:14:35,616 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(367): hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-12 08:14:35,616 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1077208093_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/export-test/export-1689149660319/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/export-test/export-1689149660319/.hbase-snapshot/testExportWithTargetName 2023-07-12 08:14:35,617 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(367): hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/export-test/export-1689149660319/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-12 08:14:35,617 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(367): hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/export-test/export-1689149660319/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-12 08:14:35,627 INFO [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-12 08:14:35,632 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-12 08:14:35,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-12 08:14:35,646 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149675645"}]},"ts":"1689149675645"} 2023-07-12 08:14:35,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-12 08:14:35,647 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-12 08:14:35,650 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-12 08:14:35,652 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=959e006f0c29b3379aa83c208264db76, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=6fdff36197adb9ea91586f96daf4c308, UNASSIGN}] 2023-07-12 08:14:35,654 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=959e006f0c29b3379aa83c208264db76, UNASSIGN 2023-07-12 08:14:35,654 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=6fdff36197adb9ea91586f96daf4c308, UNASSIGN 2023-07-12 08:14:35,655 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=959e006f0c29b3379aa83c208264db76, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:35,655 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=6fdff36197adb9ea91586f96daf4c308, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:35,655 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689149657589.959e006f0c29b3379aa83c208264db76.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689149675655"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149675655"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149675655"}]},"ts":"1689149675655"} 2023-07-12 08:14:35,655 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689149657589.6fdff36197adb9ea91586f96daf4c308.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689149675655"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149675655"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149675655"}]},"ts":"1689149675655"} 2023-07-12 08:14:35,657 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 959e006f0c29b3379aa83c208264db76, server=jenkins-hbase4.apache.org,43719,1689149646718}] 2023-07-12 08:14:35,658 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 6fdff36197adb9ea91586f96daf4c308, server=jenkins-hbase4.apache.org,46655,1689149646904}] 2023-07-12 08:14:35,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-12 08:14:35,822 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 959e006f0c29b3379aa83c208264db76 2023-07-12 08:14:35,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 959e006f0c29b3379aa83c208264db76, disabling compactions & flushes 2023-07-12 08:14:35,822 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689149657589.959e006f0c29b3379aa83c208264db76. 2023-07-12 08:14:35,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689149657589.959e006f0c29b3379aa83c208264db76. 2023-07-12 08:14:35,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689149657589.959e006f0c29b3379aa83c208264db76. after waiting 0 ms 2023-07-12 08:14:35,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689149657589.959e006f0c29b3379aa83c208264db76. 2023-07-12 08:14:35,824 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6fdff36197adb9ea91586f96daf4c308 2023-07-12 08:14:35,824 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6fdff36197adb9ea91586f96daf4c308, disabling compactions & flushes 2023-07-12 08:14:35,824 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689149657589.6fdff36197adb9ea91586f96daf4c308. 2023-07-12 08:14:35,824 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689149657589.6fdff36197adb9ea91586f96daf4c308. 2023-07-12 08:14:35,824 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689149657589.6fdff36197adb9ea91586f96daf4c308. after waiting 0 ms 2023-07-12 08:14:35,824 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689149657589.6fdff36197adb9ea91586f96daf4c308. 2023-07-12 08:14:35,845 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportWithTargetName/959e006f0c29b3379aa83c208264db76/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 08:14:35,846 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 08:14:35,848 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689149657589.959e006f0c29b3379aa83c208264db76. 2023-07-12 08:14:35,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 959e006f0c29b3379aa83c208264db76: 2023-07-12 08:14:35,849 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportWithTargetName/6fdff36197adb9ea91586f96daf4c308/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 08:14:35,850 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 08:14:35,851 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689149657589.6fdff36197adb9ea91586f96daf4c308. 2023-07-12 08:14:35,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6fdff36197adb9ea91586f96daf4c308: 2023-07-12 08:14:35,852 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 959e006f0c29b3379aa83c208264db76 2023-07-12 08:14:35,856 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=959e006f0c29b3379aa83c208264db76, regionState=CLOSED 2023-07-12 08:14:35,856 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689149657589.959e006f0c29b3379aa83c208264db76.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689149675856"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149675856"}]},"ts":"1689149675856"} 2023-07-12 08:14:35,857 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=6fdff36197adb9ea91586f96daf4c308, regionState=CLOSED 2023-07-12 08:14:35,858 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689149657589.6fdff36197adb9ea91586f96daf4c308.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689149675857"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149675857"}]},"ts":"1689149675857"} 2023-07-12 08:14:35,862 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6fdff36197adb9ea91586f96daf4c308 2023-07-12 08:14:35,869 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-12 08:14:35,869 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 959e006f0c29b3379aa83c208264db76, server=jenkins-hbase4.apache.org,43719,1689149646718 in 208 msec 2023-07-12 08:14:35,877 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-12 08:14:35,878 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 6fdff36197adb9ea91586f96daf4c308, server=jenkins-hbase4.apache.org,46655,1689149646904 in 209 msec 2023-07-12 08:14:35,881 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=959e006f0c29b3379aa83c208264db76, UNASSIGN in 217 msec 2023-07-12 08:14:35,883 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=21 2023-07-12 08:14:35,884 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=6fdff36197adb9ea91586f96daf4c308, UNASSIGN in 226 msec 2023-07-12 08:14:35,885 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149675885"}]},"ts":"1689149675885"} 2023-07-12 08:14:35,889 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-12 08:14:35,891 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-12 08:14:35,895 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 257 msec 2023-07-12 08:14:35,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-12 08:14:35,950 INFO [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-12 08:14:35,956 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-12 08:14:35,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 08:14:35,968 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 08:14:35,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-12 08:14:35,971 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 08:14:35,977 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46655] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-12 08:14:35,980 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 08:14:35,980 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 08:14:35,980 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 08:14:35,980 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 08:14:35,981 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportWithTargetName/959e006f0c29b3379aa83c208264db76 2023-07-12 08:14:35,981 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportWithTargetName/6fdff36197adb9ea91586f96daf4c308 2023-07-12 08:14:35,986 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:14:35,986 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:14:35,986 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-12 08:14:35,986 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-12 08:14:35,986 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-12 08:14:35,986 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-12 08:14:35,986 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:14:35,986 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:14:35,986 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-12 08:14:35,986 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-12 08:14:35,986 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-12 08:14:35,987 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-12 08:14:35,987 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportWithTargetName/959e006f0c29b3379aa83c208264db76/cf, FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportWithTargetName/959e006f0c29b3379aa83c208264db76/recovered.edits] 2023-07-12 08:14:35,987 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportWithTargetName/6fdff36197adb9ea91586f96daf4c308/cf, FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportWithTargetName/6fdff36197adb9ea91586f96daf4c308/recovered.edits] 2023-07-12 08:14:35,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-12 08:14:35,999 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportWithTargetName/959e006f0c29b3379aa83c208264db76/cf/b10113afa66d476faa2b5d2a5bef234e to hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/archive/data/default/testtb-testExportWithTargetName/959e006f0c29b3379aa83c208264db76/cf/b10113afa66d476faa2b5d2a5bef234e 2023-07-12 08:14:35,999 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportWithTargetName/6fdff36197adb9ea91586f96daf4c308/cf/54de231f04f247d497ba2c172c920175 to hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/archive/data/default/testtb-testExportWithTargetName/6fdff36197adb9ea91586f96daf4c308/cf/54de231f04f247d497ba2c172c920175 2023-07-12 08:14:36,004 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportWithTargetName/959e006f0c29b3379aa83c208264db76/recovered.edits/9.seqid to hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/archive/data/default/testtb-testExportWithTargetName/959e006f0c29b3379aa83c208264db76/recovered.edits/9.seqid 2023-07-12 08:14:36,004 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportWithTargetName/6fdff36197adb9ea91586f96daf4c308/recovered.edits/9.seqid to hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/archive/data/default/testtb-testExportWithTargetName/6fdff36197adb9ea91586f96daf4c308/recovered.edits/9.seqid 2023-07-12 08:14:36,005 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportWithTargetName/959e006f0c29b3379aa83c208264db76 2023-07-12 08:14:36,005 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportWithTargetName/6fdff36197adb9ea91586f96daf4c308 2023-07-12 08:14:36,005 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-12 08:14:36,009 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 08:14:36,039 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-12 08:14:36,043 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-12 08:14:36,045 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 08:14:36,045 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-12 08:14:36,046 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689149657589.959e006f0c29b3379aa83c208264db76.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689149676045"}]},"ts":"9223372036854775807"} 2023-07-12 08:14:36,046 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689149657589.6fdff36197adb9ea91586f96daf4c308.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689149676045"}]},"ts":"9223372036854775807"} 2023-07-12 08:14:36,048 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 08:14:36,048 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 959e006f0c29b3379aa83c208264db76, NAME => 'testtb-testExportWithTargetName,,1689149657589.959e006f0c29b3379aa83c208264db76.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 6fdff36197adb9ea91586f96daf4c308, NAME => 'testtb-testExportWithTargetName,1,1689149657589.6fdff36197adb9ea91586f96daf4c308.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 08:14:36,048 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-12 08:14:36,049 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689149676049"}]},"ts":"9223372036854775807"} 2023-07-12 08:14:36,051 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-12 08:14:36,053 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 08:14:36,055 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 95 msec 2023-07-12 08:14:36,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-12 08:14:36,092 INFO [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-12 08:14:36,111 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-12 08:14:36,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:36,117 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-12 08:14:36,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-12 08:14:36,150 INFO [Listener at jenkins-hbase4.apache.org/39391] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=755 (was 708) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/cluster_1daca596-97fc-0b49-6883-d88e991fb0ab/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: IPC Client (1822682432) connection to jenkins-hbase4.apache.org/172.31.14.131:42547 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/cluster_1daca596-97fc-0b49-6883-d88e991fb0ab/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/cluster_1daca596-97fc-0b49-6883-d88e991fb0ab/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xb137b52-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1822682432) connection to jenkins-hbase4.apache.org/172.31.14.131:34969 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/cluster_1daca596-97fc-0b49-6883-d88e991fb0ab/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xb137b52-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/cluster_1daca596-97fc-0b49-6883-d88e991fb0ab/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-131169972_1 at /127.0.0.1:43792 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1283 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1077208093_17 at /127.0.0.1:48658 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/cluster_1daca596-97fc-0b49-6883-d88e991fb0ab/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-131169972_1 at /127.0.0.1:60742 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xb137b52-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xb137b52-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1077208093_17 at /127.0.0.1:43810 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=919 (was 896) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=370 (was 381), ProcessCount=179 (was 173) - ProcessCount LEAK? -, AvailableMemoryMB=3430 (was 5230) 2023-07-12 08:14:36,151 WARN [Listener at jenkins-hbase4.apache.org/39391] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-07-12 08:14:36,171 INFO [Listener at jenkins-hbase4.apache.org/39391] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=755, OpenFileDescriptor=919, MaxFileDescriptor=60000, SystemLoadAverage=370, ProcessCount=179, AvailableMemoryMB=3430 2023-07-12 08:14:36,171 WARN [Listener at jenkins-hbase4.apache.org/39391] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-07-12 08:14:36,173 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 08:14:36,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-12 08:14:36,178 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 08:14:36,178 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-12 08:14:36,179 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 08:14:36,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 08:14:36,182 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemState/e3f320cfbb61bd178778bb4aeac7b3ed 2023-07-12 08:14:36,182 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemState/9dd31a03087fa63e110707928efc2a2c 2023-07-12 08:14:36,182 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemState/e3f320cfbb61bd178778bb4aeac7b3ed empty. 2023-07-12 08:14:36,182 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemState/9dd31a03087fa63e110707928efc2a2c empty. 2023-07-12 08:14:36,183 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemState/e3f320cfbb61bd178778bb4aeac7b3ed 2023-07-12 08:14:36,183 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemState/9dd31a03087fa63e110707928efc2a2c 2023-07-12 08:14:36,183 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-12 08:14:36,199 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-12 08:14:36,201 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 9dd31a03087fa63e110707928efc2a2c, NAME => 'testtb-testExportFileSystemState,1,1689149676173.9dd31a03087fa63e110707928efc2a2c.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp 2023-07-12 08:14:36,201 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => e3f320cfbb61bd178778bb4aeac7b3ed, NAME => 'testtb-testExportFileSystemState,,1689149676173.e3f320cfbb61bd178778bb4aeac7b3ed.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp 2023-07-12 08:14:36,227 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689149676173.e3f320cfbb61bd178778bb4aeac7b3ed.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:14:36,227 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing e3f320cfbb61bd178778bb4aeac7b3ed, disabling compactions & flushes 2023-07-12 08:14:36,227 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689149676173.e3f320cfbb61bd178778bb4aeac7b3ed. 2023-07-12 08:14:36,227 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689149676173.e3f320cfbb61bd178778bb4aeac7b3ed. 2023-07-12 08:14:36,227 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689149676173.e3f320cfbb61bd178778bb4aeac7b3ed. after waiting 0 ms 2023-07-12 08:14:36,227 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689149676173.e3f320cfbb61bd178778bb4aeac7b3ed. 2023-07-12 08:14:36,227 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689149676173.e3f320cfbb61bd178778bb4aeac7b3ed. 2023-07-12 08:14:36,227 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for e3f320cfbb61bd178778bb4aeac7b3ed: 2023-07-12 08:14:36,230 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689149676173.9dd31a03087fa63e110707928efc2a2c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:14:36,231 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 9dd31a03087fa63e110707928efc2a2c, disabling compactions & flushes 2023-07-12 08:14:36,231 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689149676173.9dd31a03087fa63e110707928efc2a2c. 2023-07-12 08:14:36,231 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689149676173.9dd31a03087fa63e110707928efc2a2c. 2023-07-12 08:14:36,231 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689149676173.9dd31a03087fa63e110707928efc2a2c. after waiting 0 ms 2023-07-12 08:14:36,231 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689149676173.9dd31a03087fa63e110707928efc2a2c. 2023-07-12 08:14:36,231 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689149676173.9dd31a03087fa63e110707928efc2a2c. 2023-07-12 08:14:36,231 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 9dd31a03087fa63e110707928efc2a2c: 2023-07-12 08:14:36,234 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 08:14:36,235 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689149676173.e3f320cfbb61bd178778bb4aeac7b3ed.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689149676235"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149676235"}]},"ts":"1689149676235"} 2023-07-12 08:14:36,235 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689149676173.9dd31a03087fa63e110707928efc2a2c.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689149676235"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149676235"}]},"ts":"1689149676235"} 2023-07-12 08:14:36,238 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 08:14:36,239 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 08:14:36,239 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149676239"}]},"ts":"1689149676239"} 2023-07-12 08:14:36,240 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-12 08:14:36,244 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 08:14:36,245 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 08:14:36,245 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 08:14:36,245 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 08:14:36,245 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 08:14:36,245 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e3f320cfbb61bd178778bb4aeac7b3ed, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9dd31a03087fa63e110707928efc2a2c, ASSIGN}] 2023-07-12 08:14:36,248 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9dd31a03087fa63e110707928efc2a2c, ASSIGN 2023-07-12 08:14:36,248 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e3f320cfbb61bd178778bb4aeac7b3ed, ASSIGN 2023-07-12 08:14:36,249 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9dd31a03087fa63e110707928efc2a2c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43131,1689149646833; forceNewPlan=false, retain=false 2023-07-12 08:14:36,249 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e3f320cfbb61bd178778bb4aeac7b3ed, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46655,1689149646904; forceNewPlan=false, retain=false 2023-07-12 08:14:36,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 08:14:36,399 INFO [jenkins-hbase4:33919] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 08:14:36,402 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=9dd31a03087fa63e110707928efc2a2c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:36,402 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=e3f320cfbb61bd178778bb4aeac7b3ed, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:36,403 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689149676173.9dd31a03087fa63e110707928efc2a2c.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689149676402"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149676402"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149676402"}]},"ts":"1689149676402"} 2023-07-12 08:14:36,403 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689149676173.e3f320cfbb61bd178778bb4aeac7b3ed.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689149676402"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149676402"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149676402"}]},"ts":"1689149676402"} 2023-07-12 08:14:36,405 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 9dd31a03087fa63e110707928efc2a2c, server=jenkins-hbase4.apache.org,43131,1689149646833}] 2023-07-12 08:14:36,406 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure e3f320cfbb61bd178778bb4aeac7b3ed, server=jenkins-hbase4.apache.org,46655,1689149646904}] 2023-07-12 08:14:36,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 08:14:36,567 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689149676173.e3f320cfbb61bd178778bb4aeac7b3ed. 2023-07-12 08:14:36,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e3f320cfbb61bd178778bb4aeac7b3ed, NAME => 'testtb-testExportFileSystemState,,1689149676173.e3f320cfbb61bd178778bb4aeac7b3ed.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 08:14:36,567 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689149676173.9dd31a03087fa63e110707928efc2a2c. 2023-07-12 08:14:36,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9dd31a03087fa63e110707928efc2a2c, NAME => 'testtb-testExportFileSystemState,1,1689149676173.9dd31a03087fa63e110707928efc2a2c.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 08:14:36,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689149676173.e3f320cfbb61bd178778bb4aeac7b3ed. service=AccessControlService 2023-07-12 08:14:36,568 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 08:14:36,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState e3f320cfbb61bd178778bb4aeac7b3ed 2023-07-12 08:14:36,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689149676173.e3f320cfbb61bd178778bb4aeac7b3ed.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:14:36,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689149676173.9dd31a03087fa63e110707928efc2a2c. service=AccessControlService 2023-07-12 08:14:36,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e3f320cfbb61bd178778bb4aeac7b3ed 2023-07-12 08:14:36,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e3f320cfbb61bd178778bb4aeac7b3ed 2023-07-12 08:14:36,568 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 08:14:36,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 9dd31a03087fa63e110707928efc2a2c 2023-07-12 08:14:36,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689149676173.9dd31a03087fa63e110707928efc2a2c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:14:36,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9dd31a03087fa63e110707928efc2a2c 2023-07-12 08:14:36,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9dd31a03087fa63e110707928efc2a2c 2023-07-12 08:14:36,570 INFO [StoreOpener-e3f320cfbb61bd178778bb4aeac7b3ed-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e3f320cfbb61bd178778bb4aeac7b3ed 2023-07-12 08:14:36,570 INFO [StoreOpener-9dd31a03087fa63e110707928efc2a2c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9dd31a03087fa63e110707928efc2a2c 2023-07-12 08:14:36,571 DEBUG [StoreOpener-e3f320cfbb61bd178778bb4aeac7b3ed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemState/e3f320cfbb61bd178778bb4aeac7b3ed/cf 2023-07-12 08:14:36,571 DEBUG [StoreOpener-e3f320cfbb61bd178778bb4aeac7b3ed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemState/e3f320cfbb61bd178778bb4aeac7b3ed/cf 2023-07-12 08:14:36,571 DEBUG [StoreOpener-9dd31a03087fa63e110707928efc2a2c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemState/9dd31a03087fa63e110707928efc2a2c/cf 2023-07-12 08:14:36,571 DEBUG [StoreOpener-9dd31a03087fa63e110707928efc2a2c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemState/9dd31a03087fa63e110707928efc2a2c/cf 2023-07-12 08:14:36,572 INFO [StoreOpener-e3f320cfbb61bd178778bb4aeac7b3ed-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e3f320cfbb61bd178778bb4aeac7b3ed columnFamilyName cf 2023-07-12 08:14:36,572 INFO [StoreOpener-9dd31a03087fa63e110707928efc2a2c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9dd31a03087fa63e110707928efc2a2c columnFamilyName cf 2023-07-12 08:14:36,572 INFO [StoreOpener-e3f320cfbb61bd178778bb4aeac7b3ed-1] regionserver.HStore(310): Store=e3f320cfbb61bd178778bb4aeac7b3ed/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 08:14:36,575 INFO [StoreOpener-9dd31a03087fa63e110707928efc2a2c-1] regionserver.HStore(310): Store=9dd31a03087fa63e110707928efc2a2c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 08:14:36,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemState/e3f320cfbb61bd178778bb4aeac7b3ed 2023-07-12 08:14:36,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemState/9dd31a03087fa63e110707928efc2a2c 2023-07-12 08:14:36,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemState/e3f320cfbb61bd178778bb4aeac7b3ed 2023-07-12 08:14:36,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemState/9dd31a03087fa63e110707928efc2a2c 2023-07-12 08:14:36,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e3f320cfbb61bd178778bb4aeac7b3ed 2023-07-12 08:14:36,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9dd31a03087fa63e110707928efc2a2c 2023-07-12 08:14:36,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemState/e3f320cfbb61bd178778bb4aeac7b3ed/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 08:14:36,592 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e3f320cfbb61bd178778bb4aeac7b3ed; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66279380, jitterRate=-0.01236027479171753}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 08:14:36,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e3f320cfbb61bd178778bb4aeac7b3ed: 2023-07-12 08:14:36,593 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689149676173.e3f320cfbb61bd178778bb4aeac7b3ed., pid=31, masterSystemTime=1689149676560 2023-07-12 08:14:36,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689149676173.e3f320cfbb61bd178778bb4aeac7b3ed. 2023-07-12 08:14:36,596 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689149676173.e3f320cfbb61bd178778bb4aeac7b3ed. 2023-07-12 08:14:36,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemState/9dd31a03087fa63e110707928efc2a2c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 08:14:36,597 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9dd31a03087fa63e110707928efc2a2c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60852858, jitterRate=-0.0932217538356781}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 08:14:36,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9dd31a03087fa63e110707928efc2a2c: 2023-07-12 08:14:36,599 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=e3f320cfbb61bd178778bb4aeac7b3ed, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:36,599 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689149676173.e3f320cfbb61bd178778bb4aeac7b3ed.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689149676599"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689149676599"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689149676599"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689149676599"}]},"ts":"1689149676599"} 2023-07-12 08:14:36,599 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689149676173.9dd31a03087fa63e110707928efc2a2c., pid=30, masterSystemTime=1689149676558 2023-07-12 08:14:36,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689149676173.9dd31a03087fa63e110707928efc2a2c. 2023-07-12 08:14:36,606 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689149676173.9dd31a03087fa63e110707928efc2a2c. 2023-07-12 08:14:36,607 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=9dd31a03087fa63e110707928efc2a2c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:36,608 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689149676173.9dd31a03087fa63e110707928efc2a2c.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689149676607"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689149676607"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689149676607"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689149676607"}]},"ts":"1689149676607"} 2023-07-12 08:14:36,610 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-12 08:14:36,610 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure e3f320cfbb61bd178778bb4aeac7b3ed, server=jenkins-hbase4.apache.org,46655,1689149646904 in 199 msec 2023-07-12 08:14:36,612 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e3f320cfbb61bd178778bb4aeac7b3ed, ASSIGN in 365 msec 2023-07-12 08:14:36,619 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-12 08:14:36,619 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 9dd31a03087fa63e110707928efc2a2c, server=jenkins-hbase4.apache.org,43131,1689149646833 in 211 msec 2023-07-12 08:14:36,623 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-07-12 08:14:36,623 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9dd31a03087fa63e110707928efc2a2c, ASSIGN in 374 msec 2023-07-12 08:14:36,624 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 08:14:36,624 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149676624"}]},"ts":"1689149676624"} 2023-07-12 08:14:36,626 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-12 08:14:36,629 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 08:14:36,630 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-12 08:14:36,632 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46655] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 08:14:36,634 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:14:36,634 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:14:36,634 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:14:36,634 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:14:36,635 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 08:14:36,635 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 08:14:36,636 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 08:14:36,636 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 08:14:36,638 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 460 msec 2023-07-12 08:14:36,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 08:14:36,783 INFO [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-12 08:14:36,784 DEBUG [Listener at jenkins-hbase4.apache.org/39391] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemState get assigned. Timeout = 60000ms 2023-07-12 08:14:36,784 INFO [Listener at jenkins-hbase4.apache.org/39391] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 08:14:36,787 INFO [Listener at jenkins-hbase4.apache.org/39391] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemState assigned to meta. Checking AM states. 2023-07-12 08:14:36,788 INFO [Listener at jenkins-hbase4.apache.org/39391] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 08:14:36,788 INFO [Listener at jenkins-hbase4.apache.org/39391] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemState assigned. 2023-07-12 08:14:36,791 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 08:14:36,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689149676791 (current time:1689149676791). 2023-07-12 08:14:36,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 08:14:36,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] zookeeper.ReadOnlyZKClient(139): Connect 0x4d93f016 to 127.0.0.1:54842 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:14:36,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@71b2944a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:14:36,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:14:36,800 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55164, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:14:36,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4d93f016 to 127.0.0.1:54842 2023-07-12 08:14:36,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:14:36,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] zookeeper.ReadOnlyZKClient(139): Connect 0x148ce905 to 127.0.0.1:54842 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:14:36,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@464db8c2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:14:36,809 DEBUG [hconnection-0x23387485-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:14:36,812 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55166, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:14:36,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:14:36,816 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43486, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:14:36,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x148ce905 to 127.0.0.1:54842 2023-07-12 08:14:36,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:14:36,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 08:14:36,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 08:14:36,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 08:14:36,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 08:14:36,821 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 08:14:36,823 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689150276823 2023-07-12 08:14:36,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 08:14:36,823 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-12 08:14:36,824 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 08:14:36,824 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 08:14:36,825 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 08:14:36,826 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 08:14:36,827 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-12 08:14:36,828 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 08:14:36,829 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689150276829 2023-07-12 08:14:36,851 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,851 INFO [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-12 08:14:36,851 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:14:36,853 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-12 08:14:36,853 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-12 08:14:36,853 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,853 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,855 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:36,855 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:36,855 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:36,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:36,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:36,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:36,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:36,856 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:36,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,856 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:36,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,857 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:36,857 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:36,857 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:36,857 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:36,857 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 08:14:36,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-12 08:14:36,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-12 08:14:36,857 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 08:14:36,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,857 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 08:14:36,858 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,858 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,858 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,858 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 08:14:36,858 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 08:14:36,858 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:14:36,858 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:14:36,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-12 08:14:36,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,860 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 08:14:36,860 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-12 08:14:36,859 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 08:14:36,860 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-12 08:14:36,860 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43131,1689149646833' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-12 08:14:36,860 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43719,1689149646718' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-12 08:14:36,860 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 08:14:36,861 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,861 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 08:14:36,861 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:14:36,862 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 08:14:36,862 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-12 08:14:36,862 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46655,1689149646904' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-12 08:14:36,871 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,871 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:36,871 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:36,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:36,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:36,872 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:36,872 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,872 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,872 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:14:36,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:36,872 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,872 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:14:36,872 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,872 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:14:36,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:36,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:36,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:36,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:36,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:36,874 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43131,1689149646833' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-12 08:14:36,874 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9362455[Count = 1] remaining members to acquire global barrier 2023-07-12 08:14:36,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:36,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:36,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:36,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:36,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:36,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:36,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:36,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:36,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:36,877 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46655,1689149646904' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-12 08:14:36,877 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9362455[Count = 0] remaining members to acquire global barrier 2023-07-12 08:14:36,877 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-12 08:14:36,877 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,878 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,878 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,878 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,878 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:36,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,878 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 08:14:36,878 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 08:14:36,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,879 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:36,879 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 08:14:36,879 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 08:14:36,879 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-12 08:14:36,879 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 08:14:36,879 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 08:14:36,879 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689149676173.e3f320cfbb61bd178778bb4aeac7b3ed. 2023-07-12 08:14:36,879 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 08:14:36,879 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689149676173.e3f320cfbb61bd178778bb4aeac7b3ed. started... 2023-07-12 08:14:36,879 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 08:14:36,879 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689149676173.9dd31a03087fa63e110707928efc2a2c. 2023-07-12 08:14:36,879 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43719,1689149646718' in zk 2023-07-12 08:14:36,879 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689149676173.9dd31a03087fa63e110707928efc2a2c. started... 2023-07-12 08:14:36,880 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e3f320cfbb61bd178778bb4aeac7b3ed: 2023-07-12 08:14:36,881 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9dd31a03087fa63e110707928efc2a2c: 2023-07-12 08:14:36,881 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689149676173.9dd31a03087fa63e110707928efc2a2c.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,881 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689149676173.e3f320cfbb61bd178778bb4aeac7b3ed.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,881 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 08:14:36,881 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 08:14:36,881 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 08:14:36,882 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 08:14:36,884 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 08:14:36,884 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:14:36,884 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-12 08:14:36,895 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689149676173.9dd31a03087fa63e110707928efc2a2c. completed. 2023-07-12 08:14:36,895 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689149676173.9dd31a03087fa63e110707928efc2a2c. 2023-07-12 08:14:36,895 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 08:14:36,895 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 08:14:36,895 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:36,895 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-12 08:14:36,895 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43131,1689149646833' in zk 2023-07-12 08:14:36,897 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 08:14:36,897 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:14:36,897 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:36,897 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-12 08:14:36,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:36,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:36,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:36,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:36,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:36,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:36,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:36,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:36,901 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689149676173.e3f320cfbb61bd178778bb4aeac7b3ed. completed. 2023-07-12 08:14:36,902 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689149676173.e3f320cfbb61bd178778bb4aeac7b3ed. 2023-07-12 08:14:36,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:36,902 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 08:14:36,902 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 08:14:36,902 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:36,902 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-12 08:14:36,902 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46655,1689149646904' in zk 2023-07-12 08:14:36,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:36,903 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:36,903 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 08:14:36,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:36,903 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:14:36,904 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-12 08:14:36,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,43131,1689149646833': 2023-07-12 08:14:36,905 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43131,1689149646833' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-12 08:14:36,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:36,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:36,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:36,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:36,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:36,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:36,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:36,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:36,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:36,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:36,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:36,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:36,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,46655,1689149646904': 2023-07-12 08:14:36,910 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46655,1689149646904' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-12 08:14:36,910 INFO [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-12 08:14:36,910 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 08:14:36,910 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 08:14:36,910 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,910 INFO [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 08:14:36,912 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,912 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,912 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:36,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:36,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,912 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:36,912 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,913 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:36,912 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:36,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:36,912 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:36,913 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:36,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:36,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:36,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:36,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:36,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:36,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:36,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,914 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:36,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:36,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:36,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:36,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:36,916 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:36,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:36,916 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:36,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,916 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:36,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:36,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:36,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:36,921 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:36,921 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:36,922 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:36,922 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:36,922 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:36,922 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:36,922 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:36,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:36,922 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:36,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:36,922 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:14:36,922 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:36,922 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:36,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:36,922 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:36,923 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:36,922 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:36,924 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:36,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:36,924 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:14:36,924 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:36,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:36,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:36,924 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:36,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:36,924 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:36,925 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,925 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 08:14:36,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 08:14:36,925 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 08:14:36,926 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,951 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,976 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-12 08:14:36,976 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,977 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:36,977 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689149676823Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689149676924 (+101 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689149676924Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689149676930 (+6 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689149676944 (+14 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689149676976 (+32 ms) 2023-07-12 08:14:36,979 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 08:14:36,982 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 156 msec 2023-07-12 08:14:37,126 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:14:37,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 08:14:37,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 08:14:37,138 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46655] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689149676173.e3f320cfbb61bd178778bb4aeac7b3ed. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 08:14:37,140 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43131] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689149676173.9dd31a03087fa63e110707928efc2a2c. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 08:14:37,145 DEBUG [Listener at jenkins-hbase4.apache.org/39391] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-12 08:14:37,145 DEBUG [Listener at jenkins-hbase4.apache.org/39391] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689149676173.e3f320cfbb61bd178778bb4aeac7b3ed. 2023-07-12 08:14:37,146 INFO [Listener at jenkins-hbase4.apache.org/39391] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 08:14:37,159 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 08:14:37,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689149677159 (current time:1689149677159). 2023-07-12 08:14:37,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 08:14:37,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] zookeeper.ReadOnlyZKClient(139): Connect 0x6da4c1a0 to 127.0.0.1:54842 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:14:37,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4187bb76, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:14:37,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:14:37,169 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55174, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:14:37,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6da4c1a0 to 127.0.0.1:54842 2023-07-12 08:14:37,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:14:37,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] zookeeper.ReadOnlyZKClient(139): Connect 0x6b30b538 to 127.0.0.1:54842 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:14:37,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5cf29348, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:14:37,179 DEBUG [hconnection-0x65155977-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:14:37,180 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55188, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:14:37,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:14:37,186 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43500, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:14:37,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6b30b538 to 127.0.0.1:54842 2023-07-12 08:14:37,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:14:37,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 08:14:37,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 08:14:37,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 08:14:37,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 08:14:37,191 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 08:14:37,192 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689150277192 2023-07-12 08:14:37,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 08:14:37,192 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-12 08:14:37,193 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 08:14:37,193 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 08:14:37,195 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 08:14:37,195 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 08:14:37,196 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-12 08:14:37,197 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 08:14:37,198 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689150277198 2023-07-12 08:14:37,211 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-12 08:14:37,211 INFO [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-12 08:14:37,211 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:14:37,212 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-12 08:14:37,212 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-12 08:14:37,213 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 08:14:37,213 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 08:14:37,214 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:37,214 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:37,214 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:37,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:37,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:37,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:37,214 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:37,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:37,215 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:37,215 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:37,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:37,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:37,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 08:14:37,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 08:14:37,216 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:37,216 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 08:14:37,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 08:14:37,216 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 08:14:37,216 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 08:14:37,216 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 08:14:37,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-12 08:14:37,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-12 08:14:37,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-12 08:14:37,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 08:14:37,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 08:14:37,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 08:14:37,217 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 08:14:37,217 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 08:14:37,217 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 08:14:37,217 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-12 08:14:37,217 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 08:14:37,217 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-12 08:14:37,217 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:14:37,218 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 08:14:37,219 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 08:14:37,219 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-12 08:14:37,217 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-12 08:14:37,219 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43131,1689149646833' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-12 08:14:37,219 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 08:14:37,219 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:14:37,219 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:14:37,220 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 08:14:37,221 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 08:14:37,221 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-12 08:14:37,221 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46655,1689149646904' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-12 08:14:37,221 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-12 08:14:37,221 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43719,1689149646718' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-12 08:14:37,223 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 08:14:37,223 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 08:14:37,223 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:37,223 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:37,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:37,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:37,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:37,223 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 08:14:37,223 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 08:14:37,223 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:14:37,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:37,223 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 08:14:37,224 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:14:37,224 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 08:14:37,224 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:14:37,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:37,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 08:14:37,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:37,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:37,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:37,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:37,226 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43131,1689149646833' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-12 08:14:37,226 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@296641de[Count = 1] remaining members to acquire global barrier 2023-07-12 08:14:37,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:37,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:37,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:37,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:37,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:37,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 08:14:37,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:37,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:37,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:37,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:37,228 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46655,1689149646904' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-12 08:14:37,228 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@296641de[Count = 0] remaining members to acquire global barrier 2023-07-12 08:14:37,228 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-12 08:14:37,228 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 08:14:37,230 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 08:14:37,230 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 08:14:37,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 08:14:37,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 08:14:37,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 08:14:37,230 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 08:14:37,230 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 08:14:37,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 08:14:37,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 08:14:37,230 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:37,230 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 08:14:37,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 08:14:37,230 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-12 08:14:37,230 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43719,1689149646718' in zk 2023-07-12 08:14:37,230 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 08:14:37,231 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689149676173.e3f320cfbb61bd178778bb4aeac7b3ed. 2023-07-12 08:14:37,231 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:37,231 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 08:14:37,231 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 08:14:37,231 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 08:14:37,231 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689149676173.9dd31a03087fa63e110707928efc2a2c. 2023-07-12 08:14:37,230 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 08:14:37,231 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689149676173.9dd31a03087fa63e110707928efc2a2c. started... 2023-07-12 08:14:37,231 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 08:14:37,231 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689149676173.e3f320cfbb61bd178778bb4aeac7b3ed. started... 2023-07-12 08:14:37,231 INFO [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e3f320cfbb61bd178778bb4aeac7b3ed 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-12 08:14:37,231 INFO [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9dd31a03087fa63e110707928efc2a2c 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-12 08:14:37,232 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 08:14:37,232 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:14:37,232 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-12 08:14:37,245 INFO [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemState/e3f320cfbb61bd178778bb4aeac7b3ed/.tmp/cf/2e3c5772136a4ba1a9a6e1cb5e596db0 2023-07-12 08:14:37,248 INFO [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemState/9dd31a03087fa63e110707928efc2a2c/.tmp/cf/0bc37757bea84c3abc60d2ac87e79ce0 2023-07-12 08:14:37,255 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemState/e3f320cfbb61bd178778bb4aeac7b3ed/.tmp/cf/2e3c5772136a4ba1a9a6e1cb5e596db0 as hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemState/e3f320cfbb61bd178778bb4aeac7b3ed/cf/2e3c5772136a4ba1a9a6e1cb5e596db0 2023-07-12 08:14:37,259 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemState/9dd31a03087fa63e110707928efc2a2c/.tmp/cf/0bc37757bea84c3abc60d2ac87e79ce0 as hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemState/9dd31a03087fa63e110707928efc2a2c/cf/0bc37757bea84c3abc60d2ac87e79ce0 2023-07-12 08:14:37,262 INFO [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemState/e3f320cfbb61bd178778bb4aeac7b3ed/cf/2e3c5772136a4ba1a9a6e1cb5e596db0, entries=4, sequenceid=6, filesize=5.1 K 2023-07-12 08:14:37,265 INFO [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for e3f320cfbb61bd178778bb4aeac7b3ed in 34ms, sequenceid=6, compaction requested=false 2023-07-12 08:14:37,265 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-12 08:14:37,266 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e3f320cfbb61bd178778bb4aeac7b3ed: 2023-07-12 08:14:37,266 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689149676173.e3f320cfbb61bd178778bb4aeac7b3ed.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-12 08:14:37,266 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 08:14:37,266 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemState/e3f320cfbb61bd178778bb4aeac7b3ed/cf/2e3c5772136a4ba1a9a6e1cb5e596db0] hfiles 2023-07-12 08:14:37,266 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemState/e3f320cfbb61bd178778bb4aeac7b3ed/cf/2e3c5772136a4ba1a9a6e1cb5e596db0 for snapshot=snaptb0-testExportFileSystemState 2023-07-12 08:14:37,268 INFO [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemState/9dd31a03087fa63e110707928efc2a2c/cf/0bc37757bea84c3abc60d2ac87e79ce0, entries=46, sequenceid=6, filesize=7.9 K 2023-07-12 08:14:37,270 INFO [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 9dd31a03087fa63e110707928efc2a2c in 39ms, sequenceid=6, compaction requested=false 2023-07-12 08:14:37,271 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9dd31a03087fa63e110707928efc2a2c: 2023-07-12 08:14:37,272 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689149676173.9dd31a03087fa63e110707928efc2a2c.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-12 08:14:37,272 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 08:14:37,272 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemState/9dd31a03087fa63e110707928efc2a2c/cf/0bc37757bea84c3abc60d2ac87e79ce0] hfiles 2023-07-12 08:14:37,272 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemState/9dd31a03087fa63e110707928efc2a2c/cf/0bc37757bea84c3abc60d2ac87e79ce0 for snapshot=snaptb0-testExportFileSystemState 2023-07-12 08:14:37,287 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689149676173.e3f320cfbb61bd178778bb4aeac7b3ed. completed. 2023-07-12 08:14:37,287 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689149676173.e3f320cfbb61bd178778bb4aeac7b3ed. 2023-07-12 08:14:37,287 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 08:14:37,287 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 08:14:37,287 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:37,293 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-12 08:14:37,293 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46655,1689149646904' in zk 2023-07-12 08:14:37,293 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:14:37,298 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:37,298 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 08:14:37,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:37,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:37,298 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:14:37,298 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689149676173.9dd31a03087fa63e110707928efc2a2c. completed. 2023-07-12 08:14:37,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:37,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 08:14:37,298 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689149676173.9dd31a03087fa63e110707928efc2a2c. 2023-07-12 08:14:37,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 08:14:37,299 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 08:14:37,299 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 08:14:37,298 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-12 08:14:37,299 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:37,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:37,299 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 08:14:37,299 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-12 08:14:37,300 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43131,1689149646833' in zk 2023-07-12 08:14:37,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:37,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 08:14:37,301 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:37,301 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 08:14:37,301 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:14:37,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:37,301 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-12 08:14:37,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:37,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:37,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:37,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 08:14:37,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:37,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:37,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:37,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,46655,1689149646904': 2023-07-12 08:14:37,305 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46655,1689149646904' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-12 08:14:37,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:37,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:37,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:37,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:37,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:37,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 08:14:37,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:37,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:37,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:37,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:37,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 08:14:37,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:37,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:37,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:37,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,43131,1689149646833': 2023-07-12 08:14:37,309 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43131,1689149646833' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-12 08:14:37,309 INFO [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-12 08:14:37,309 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 08:14:37,309 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 08:14:37,309 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-12 08:14:37,309 INFO [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 08:14:37,311 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 08:14:37,311 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 08:14:37,311 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:37,311 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 08:14:37,311 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 08:14:37,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 08:14:37,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 08:14:37,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:37,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:37,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 08:14:37,311 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:37,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 08:14:37,311 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:37,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 08:14:37,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 08:14:37,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:37,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 08:14:37,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:37,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:37,313 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:37,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 08:14:37,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:37,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 08:14:37,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:37,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:37,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:37,313 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:37,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:37,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 08:14:37,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 08:14:37,314 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:37,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 08:14:37,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:37,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:37,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:37,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:37,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 08:14:37,320 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:37,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:37,320 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:37,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:37,320 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:37,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:37,325 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:37,325 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 08:14:37,325 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:37,325 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:37,325 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 08:14:37,325 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:37,325 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:37,325 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 08:14:37,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:37,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:37,325 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:37,325 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:37,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:37,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:37,325 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:37,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:37,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:37,326 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:14:37,325 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:37,325 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:37,325 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:37,327 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:37,326 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-12 08:14:37,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:37,327 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-12 08:14:37,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:37,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:37,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:37,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:37,327 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 08:14:37,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:37,328 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 08:14:37,328 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 08:14:37,352 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-12 08:14:37,376 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-12 08:14:37,376 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 08:14:37,378 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 08:14:37,378 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689149677192Consolidate snapshot: snaptb0-testExportFileSystemState at 1689149677327 (+135 ms)Loading Region manifests for snaptb0-testExportFileSystemState at 1689149677327Writing data manifest for snaptb0-testExportFileSystemState at 1689149677332 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689149677344 (+12 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689149677376 (+32 ms) 2023-07-12 08:14:37,380 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 08:14:37,382 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 187 msec 2023-07-12 08:14:37,500 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:14:37,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 08:14:37,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 08:14:37,503 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/export-test/export-1689149677503 2023-07-12 08:14:37,503 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34597, tgtDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/export-test/export-1689149677503, rawTgtDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/export-test/export-1689149677503, srcFsUri=hdfs://localhost:34597, srcDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4 2023-07-12 08:14:37,533 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34597, inputRoot=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4 2023-07-12 08:14:37,534 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-858828493_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/export-test/export-1689149677503, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/export-test/export-1689149677503/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 08:14:37,534 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34597, inputRoot=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4, snapshotDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-12 08:14:37,547 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/export-test/export-1689149677503/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 08:14:37,575 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:37,576 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:37,576 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:37,577 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:38,564 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/hadoop-3596189835415932529.jar 2023-07-12 08:14:38,565 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:38,565 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:38,643 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/hadoop-3697927038638905650.jar 2023-07-12 08:14:38,644 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:38,644 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:38,645 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:38,645 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:38,645 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:38,646 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:38,646 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 08:14:38,647 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 08:14:38,647 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 08:14:38,648 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 08:14:38,649 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 08:14:38,649 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 08:14:38,650 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 08:14:38,651 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 08:14:38,651 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 08:14:38,652 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 08:14:38,653 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 08:14:38,654 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 08:14:38,655 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 08:14:38,655 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 08:14:38,655 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 08:14:38,656 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 08:14:38,657 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 08:14:39,294 WARN [Listener at jenkins-hbase4.apache.org/39391] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 08:14:39,299 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-12 08:14:39,302 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-12 08:14:40,304 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 08:14:40,304 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 08:14:40,310 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656036_0001_000001 (auth:SIMPLE) 2023-07-12 08:14:41,086 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656036_0002_000001 (auth:SIMPLE) 2023-07-12 08:14:41,452 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 08:14:45,601 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656036_0002_000001 (auth:SIMPLE) 2023-07-12 08:14:47,833 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656036_0002_000001 (auth:SIMPLE) 2023-07-12 08:14:50,393 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656036_0002_000001 (auth:SIMPLE) 2023-07-12 08:14:51,579 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 08:14:51,580 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 08:14:51,587 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-12 08:14:51,587 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 08:14:51,588 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 08:14:51,588 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1077208093_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-12 08:14:51,589 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(367): hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-12 08:14:51,589 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(367): hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-12 08:14:51,589 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1077208093_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/export-test/export-1689149677503/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/export-test/export-1689149677503/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-12 08:14:51,589 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(367): hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/export-test/export-1689149677503/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-12 08:14:51,589 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(367): hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/export-test/export-1689149677503/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-12 08:14:51,597 INFO [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-12 08:14:51,598 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-12 08:14:51,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-12 08:14:51,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-12 08:14:51,604 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149691604"}]},"ts":"1689149691604"} 2023-07-12 08:14:51,606 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-12 08:14:51,608 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-12 08:14:51,609 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e3f320cfbb61bd178778bb4aeac7b3ed, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9dd31a03087fa63e110707928efc2a2c, UNASSIGN}] 2023-07-12 08:14:51,612 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9dd31a03087fa63e110707928efc2a2c, UNASSIGN 2023-07-12 08:14:51,612 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e3f320cfbb61bd178778bb4aeac7b3ed, UNASSIGN 2023-07-12 08:14:51,613 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=9dd31a03087fa63e110707928efc2a2c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:51,613 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689149676173.9dd31a03087fa63e110707928efc2a2c.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689149691613"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149691613"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149691613"}]},"ts":"1689149691613"} 2023-07-12 08:14:51,613 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=e3f320cfbb61bd178778bb4aeac7b3ed, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:51,613 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689149676173.e3f320cfbb61bd178778bb4aeac7b3ed.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689149691613"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149691613"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149691613"}]},"ts":"1689149691613"} 2023-07-12 08:14:51,615 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure 9dd31a03087fa63e110707928efc2a2c, server=jenkins-hbase4.apache.org,43131,1689149646833}] 2023-07-12 08:14:51,617 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure e3f320cfbb61bd178778bb4aeac7b3ed, server=jenkins-hbase4.apache.org,46655,1689149646904}] 2023-07-12 08:14:51,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-12 08:14:51,768 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e3f320cfbb61bd178778bb4aeac7b3ed 2023-07-12 08:14:51,769 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e3f320cfbb61bd178778bb4aeac7b3ed, disabling compactions & flushes 2023-07-12 08:14:51,769 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9dd31a03087fa63e110707928efc2a2c 2023-07-12 08:14:51,769 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689149676173.e3f320cfbb61bd178778bb4aeac7b3ed. 2023-07-12 08:14:51,769 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689149676173.e3f320cfbb61bd178778bb4aeac7b3ed. 2023-07-12 08:14:51,769 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689149676173.e3f320cfbb61bd178778bb4aeac7b3ed. after waiting 0 ms 2023-07-12 08:14:51,769 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689149676173.e3f320cfbb61bd178778bb4aeac7b3ed. 2023-07-12 08:14:51,769 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9dd31a03087fa63e110707928efc2a2c, disabling compactions & flushes 2023-07-12 08:14:51,769 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689149676173.9dd31a03087fa63e110707928efc2a2c. 2023-07-12 08:14:51,769 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689149676173.9dd31a03087fa63e110707928efc2a2c. 2023-07-12 08:14:51,769 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689149676173.9dd31a03087fa63e110707928efc2a2c. after waiting 0 ms 2023-07-12 08:14:51,769 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689149676173.9dd31a03087fa63e110707928efc2a2c. 2023-07-12 08:14:51,791 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemState/e3f320cfbb61bd178778bb4aeac7b3ed/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 08:14:51,791 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemState/9dd31a03087fa63e110707928efc2a2c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 08:14:51,792 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 08:14:51,793 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689149676173.e3f320cfbb61bd178778bb4aeac7b3ed. 2023-07-12 08:14:51,793 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e3f320cfbb61bd178778bb4aeac7b3ed: 2023-07-12 08:14:51,793 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 08:14:51,794 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689149676173.9dd31a03087fa63e110707928efc2a2c. 2023-07-12 08:14:51,794 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9dd31a03087fa63e110707928efc2a2c: 2023-07-12 08:14:51,796 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e3f320cfbb61bd178778bb4aeac7b3ed 2023-07-12 08:14:51,797 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=e3f320cfbb61bd178778bb4aeac7b3ed, regionState=CLOSED 2023-07-12 08:14:51,797 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689149676173.e3f320cfbb61bd178778bb4aeac7b3ed.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689149691797"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149691797"}]},"ts":"1689149691797"} 2023-07-12 08:14:51,797 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9dd31a03087fa63e110707928efc2a2c 2023-07-12 08:14:51,798 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=9dd31a03087fa63e110707928efc2a2c, regionState=CLOSED 2023-07-12 08:14:51,798 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689149676173.9dd31a03087fa63e110707928efc2a2c.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689149691798"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149691798"}]},"ts":"1689149691798"} 2023-07-12 08:14:51,801 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=37 2023-07-12 08:14:51,801 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure e3f320cfbb61bd178778bb4aeac7b3ed, server=jenkins-hbase4.apache.org,46655,1689149646904 in 183 msec 2023-07-12 08:14:51,802 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=38 2023-07-12 08:14:51,802 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure 9dd31a03087fa63e110707928efc2a2c, server=jenkins-hbase4.apache.org,43131,1689149646833 in 185 msec 2023-07-12 08:14:51,803 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e3f320cfbb61bd178778bb4aeac7b3ed, UNASSIGN in 192 msec 2023-07-12 08:14:51,805 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-12 08:14:51,805 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9dd31a03087fa63e110707928efc2a2c, UNASSIGN in 193 msec 2023-07-12 08:14:51,806 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149691806"}]},"ts":"1689149691806"} 2023-07-12 08:14:51,807 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-12 08:14:51,810 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-12 08:14:51,813 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 213 msec 2023-07-12 08:14:51,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-12 08:14:51,907 INFO [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-12 08:14:51,908 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-12 08:14:51,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 08:14:51,918 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 08:14:51,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-12 08:14:51,919 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 08:14:51,920 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46655] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-12 08:14:51,924 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemState/e3f320cfbb61bd178778bb4aeac7b3ed 2023-07-12 08:14:51,925 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemState/9dd31a03087fa63e110707928efc2a2c 2023-07-12 08:14:51,927 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemState/e3f320cfbb61bd178778bb4aeac7b3ed/cf, FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemState/e3f320cfbb61bd178778bb4aeac7b3ed/recovered.edits] 2023-07-12 08:14:51,927 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemState/9dd31a03087fa63e110707928efc2a2c/cf, FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemState/9dd31a03087fa63e110707928efc2a2c/recovered.edits] 2023-07-12 08:14:51,927 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 08:14:51,928 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 08:14:51,928 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 08:14:51,928 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 08:14:51,928 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-12 08:14:51,929 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-12 08:14:51,928 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-12 08:14:51,928 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-12 08:14:51,929 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 08:14:51,929 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 08:14:51,929 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 08:14:51,929 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:14:51,930 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 08:14:51,930 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:14:51,929 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:14:51,929 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:14:51,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-12 08:14:51,936 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemState/9dd31a03087fa63e110707928efc2a2c/cf/0bc37757bea84c3abc60d2ac87e79ce0 to hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/archive/data/default/testtb-testExportFileSystemState/9dd31a03087fa63e110707928efc2a2c/cf/0bc37757bea84c3abc60d2ac87e79ce0 2023-07-12 08:14:51,937 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemState/e3f320cfbb61bd178778bb4aeac7b3ed/cf/2e3c5772136a4ba1a9a6e1cb5e596db0 to hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/archive/data/default/testtb-testExportFileSystemState/e3f320cfbb61bd178778bb4aeac7b3ed/cf/2e3c5772136a4ba1a9a6e1cb5e596db0 2023-07-12 08:14:51,943 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemState/9dd31a03087fa63e110707928efc2a2c/recovered.edits/9.seqid to hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/archive/data/default/testtb-testExportFileSystemState/9dd31a03087fa63e110707928efc2a2c/recovered.edits/9.seqid 2023-07-12 08:14:51,943 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemState/e3f320cfbb61bd178778bb4aeac7b3ed/recovered.edits/9.seqid to hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/archive/data/default/testtb-testExportFileSystemState/e3f320cfbb61bd178778bb4aeac7b3ed/recovered.edits/9.seqid 2023-07-12 08:14:51,944 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemState/9dd31a03087fa63e110707928efc2a2c 2023-07-12 08:14:51,944 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemState/e3f320cfbb61bd178778bb4aeac7b3ed 2023-07-12 08:14:51,944 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-12 08:14:51,947 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 08:14:51,950 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-12 08:14:51,953 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-12 08:14:51,954 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 08:14:51,954 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-12 08:14:51,955 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689149676173.e3f320cfbb61bd178778bb4aeac7b3ed.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689149691955"}]},"ts":"9223372036854775807"} 2023-07-12 08:14:51,955 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689149676173.9dd31a03087fa63e110707928efc2a2c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689149691955"}]},"ts":"9223372036854775807"} 2023-07-12 08:14:51,958 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 08:14:51,958 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e3f320cfbb61bd178778bb4aeac7b3ed, NAME => 'testtb-testExportFileSystemState,,1689149676173.e3f320cfbb61bd178778bb4aeac7b3ed.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 9dd31a03087fa63e110707928efc2a2c, NAME => 'testtb-testExportFileSystemState,1,1689149676173.9dd31a03087fa63e110707928efc2a2c.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 08:14:51,958 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-12 08:14:51,958 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689149691958"}]},"ts":"9223372036854775807"} 2023-07-12 08:14:51,961 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-12 08:14:51,964 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 08:14:51,966 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 56 msec 2023-07-12 08:14:52,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-12 08:14:52,035 INFO [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-12 08:14:52,045 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-12 08:14:52,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:52,049 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-12 08:14:52,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-12 08:14:52,084 INFO [Listener at jenkins-hbase4.apache.org/39391] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=769 (was 755) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1077208093_17 at /127.0.0.1:45218 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_465562097_1 at /127.0.0.1:47736 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1822682432) connection to jenkins-hbase4.apache.org/172.31.14.131:33835 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xb137b52-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xb137b52-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xb137b52-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1077208093_17 at /127.0.0.1:47776 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_465562097_1 at /127.0.0.1:48454 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1950 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xb137b52-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1822682432) connection to jenkins-hbase4.apache.org/172.31.14.131:46597 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1077208093_17 at /127.0.0.1:48472 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=925 (was 919) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=396 (was 370) - SystemLoadAverage LEAK? -, ProcessCount=182 (was 179) - ProcessCount LEAK? -, AvailableMemoryMB=2720 (was 3430) 2023-07-12 08:14:52,085 WARN [Listener at jenkins-hbase4.apache.org/39391] hbase.ResourceChecker(130): Thread=769 is superior to 500 2023-07-12 08:14:52,113 INFO [Listener at jenkins-hbase4.apache.org/39391] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=769, OpenFileDescriptor=925, MaxFileDescriptor=60000, SystemLoadAverage=396, ProcessCount=182, AvailableMemoryMB=2692 2023-07-12 08:14:52,113 WARN [Listener at jenkins-hbase4.apache.org/39391] hbase.ResourceChecker(130): Thread=769 is superior to 500 2023-07-12 08:14:52,116 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 08:14:52,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-12 08:14:52,125 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 08:14:52,125 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-12 08:14:52,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-12 08:14:52,129 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 08:14:52,132 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testConsecutiveExports/8693ba88cfdbde5de1a79fca2fae875c 2023-07-12 08:14:52,133 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testConsecutiveExports/8693ba88cfdbde5de1a79fca2fae875c empty. 2023-07-12 08:14:52,133 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testConsecutiveExports/2a33bf1b9115e3c642569163a157fa8a 2023-07-12 08:14:52,133 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testConsecutiveExports/8693ba88cfdbde5de1a79fca2fae875c 2023-07-12 08:14:52,133 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testConsecutiveExports/2a33bf1b9115e3c642569163a157fa8a empty. 2023-07-12 08:14:52,134 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testConsecutiveExports/2a33bf1b9115e3c642569163a157fa8a 2023-07-12 08:14:52,134 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-12 08:14:52,159 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-12 08:14:52,161 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8693ba88cfdbde5de1a79fca2fae875c, NAME => 'testtb-testConsecutiveExports,,1689149692115.8693ba88cfdbde5de1a79fca2fae875c.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp 2023-07-12 08:14:52,161 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 2a33bf1b9115e3c642569163a157fa8a, NAME => 'testtb-testConsecutiveExports,1,1689149692115.2a33bf1b9115e3c642569163a157fa8a.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp 2023-07-12 08:14:52,183 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689149692115.2a33bf1b9115e3c642569163a157fa8a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:14:52,183 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 2a33bf1b9115e3c642569163a157fa8a, disabling compactions & flushes 2023-07-12 08:14:52,183 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689149692115.2a33bf1b9115e3c642569163a157fa8a. 2023-07-12 08:14:52,183 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689149692115.2a33bf1b9115e3c642569163a157fa8a. 2023-07-12 08:14:52,183 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689149692115.2a33bf1b9115e3c642569163a157fa8a. after waiting 0 ms 2023-07-12 08:14:52,183 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689149692115.2a33bf1b9115e3c642569163a157fa8a. 2023-07-12 08:14:52,183 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689149692115.2a33bf1b9115e3c642569163a157fa8a. 2023-07-12 08:14:52,184 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 2a33bf1b9115e3c642569163a157fa8a: 2023-07-12 08:14:52,189 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689149692115.8693ba88cfdbde5de1a79fca2fae875c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:14:52,189 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 8693ba88cfdbde5de1a79fca2fae875c, disabling compactions & flushes 2023-07-12 08:14:52,189 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689149692115.8693ba88cfdbde5de1a79fca2fae875c. 2023-07-12 08:14:52,189 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689149692115.8693ba88cfdbde5de1a79fca2fae875c. 2023-07-12 08:14:52,189 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689149692115.8693ba88cfdbde5de1a79fca2fae875c. after waiting 0 ms 2023-07-12 08:14:52,189 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689149692115.8693ba88cfdbde5de1a79fca2fae875c. 2023-07-12 08:14:52,189 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689149692115.8693ba88cfdbde5de1a79fca2fae875c. 2023-07-12 08:14:52,189 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 8693ba88cfdbde5de1a79fca2fae875c: 2023-07-12 08:14:52,192 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 08:14:52,193 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689149692115.2a33bf1b9115e3c642569163a157fa8a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689149692192"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149692192"}]},"ts":"1689149692192"} 2023-07-12 08:14:52,193 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689149692115.8693ba88cfdbde5de1a79fca2fae875c.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689149692192"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149692192"}]},"ts":"1689149692192"} 2023-07-12 08:14:52,195 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 08:14:52,197 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 08:14:52,197 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149692197"}]},"ts":"1689149692197"} 2023-07-12 08:14:52,198 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-12 08:14:52,202 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 08:14:52,203 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 08:14:52,203 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 08:14:52,203 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 08:14:52,203 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 08:14:52,203 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8693ba88cfdbde5de1a79fca2fae875c, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=2a33bf1b9115e3c642569163a157fa8a, ASSIGN}] 2023-07-12 08:14:52,206 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=2a33bf1b9115e3c642569163a157fa8a, ASSIGN 2023-07-12 08:14:52,207 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8693ba88cfdbde5de1a79fca2fae875c, ASSIGN 2023-07-12 08:14:52,210 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8693ba88cfdbde5de1a79fca2fae875c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43719,1689149646718; forceNewPlan=false, retain=false 2023-07-12 08:14:52,210 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=2a33bf1b9115e3c642569163a157fa8a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43131,1689149646833; forceNewPlan=false, retain=false 2023-07-12 08:14:52,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-12 08:14:52,361 INFO [jenkins-hbase4:33919] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 08:14:52,364 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=8693ba88cfdbde5de1a79fca2fae875c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:52,364 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=2a33bf1b9115e3c642569163a157fa8a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:52,364 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689149692115.8693ba88cfdbde5de1a79fca2fae875c.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689149692363"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149692363"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149692363"}]},"ts":"1689149692363"} 2023-07-12 08:14:52,364 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689149692115.2a33bf1b9115e3c642569163a157fa8a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689149692363"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149692363"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149692363"}]},"ts":"1689149692363"} 2023-07-12 08:14:52,366 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 8693ba88cfdbde5de1a79fca2fae875c, server=jenkins-hbase4.apache.org,43719,1689149646718}] 2023-07-12 08:14:52,367 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 2a33bf1b9115e3c642569163a157fa8a, server=jenkins-hbase4.apache.org,43131,1689149646833}] 2023-07-12 08:14:52,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-12 08:14:52,528 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689149692115.2a33bf1b9115e3c642569163a157fa8a. 2023-07-12 08:14:52,528 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689149692115.8693ba88cfdbde5de1a79fca2fae875c. 2023-07-12 08:14:52,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2a33bf1b9115e3c642569163a157fa8a, NAME => 'testtb-testConsecutiveExports,1,1689149692115.2a33bf1b9115e3c642569163a157fa8a.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 08:14:52,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8693ba88cfdbde5de1a79fca2fae875c, NAME => 'testtb-testConsecutiveExports,,1689149692115.8693ba88cfdbde5de1a79fca2fae875c.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 08:14:52,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689149692115.2a33bf1b9115e3c642569163a157fa8a. service=AccessControlService 2023-07-12 08:14:52,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689149692115.8693ba88cfdbde5de1a79fca2fae875c. service=AccessControlService 2023-07-12 08:14:52,528 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 08:14:52,528 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 08:14:52,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 2a33bf1b9115e3c642569163a157fa8a 2023-07-12 08:14:52,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 8693ba88cfdbde5de1a79fca2fae875c 2023-07-12 08:14:52,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689149692115.2a33bf1b9115e3c642569163a157fa8a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:14:52,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689149692115.8693ba88cfdbde5de1a79fca2fae875c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:14:52,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2a33bf1b9115e3c642569163a157fa8a 2023-07-12 08:14:52,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8693ba88cfdbde5de1a79fca2fae875c 2023-07-12 08:14:52,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8693ba88cfdbde5de1a79fca2fae875c 2023-07-12 08:14:52,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2a33bf1b9115e3c642569163a157fa8a 2023-07-12 08:14:52,531 INFO [StoreOpener-8693ba88cfdbde5de1a79fca2fae875c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8693ba88cfdbde5de1a79fca2fae875c 2023-07-12 08:14:52,531 INFO [StoreOpener-2a33bf1b9115e3c642569163a157fa8a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2a33bf1b9115e3c642569163a157fa8a 2023-07-12 08:14:52,533 DEBUG [StoreOpener-2a33bf1b9115e3c642569163a157fa8a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testConsecutiveExports/2a33bf1b9115e3c642569163a157fa8a/cf 2023-07-12 08:14:52,533 DEBUG [StoreOpener-8693ba88cfdbde5de1a79fca2fae875c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testConsecutiveExports/8693ba88cfdbde5de1a79fca2fae875c/cf 2023-07-12 08:14:52,533 DEBUG [StoreOpener-2a33bf1b9115e3c642569163a157fa8a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testConsecutiveExports/2a33bf1b9115e3c642569163a157fa8a/cf 2023-07-12 08:14:52,533 DEBUG [StoreOpener-8693ba88cfdbde5de1a79fca2fae875c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testConsecutiveExports/8693ba88cfdbde5de1a79fca2fae875c/cf 2023-07-12 08:14:52,533 INFO [StoreOpener-2a33bf1b9115e3c642569163a157fa8a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2a33bf1b9115e3c642569163a157fa8a columnFamilyName cf 2023-07-12 08:14:52,533 INFO [StoreOpener-8693ba88cfdbde5de1a79fca2fae875c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8693ba88cfdbde5de1a79fca2fae875c columnFamilyName cf 2023-07-12 08:14:52,534 INFO [StoreOpener-2a33bf1b9115e3c642569163a157fa8a-1] regionserver.HStore(310): Store=2a33bf1b9115e3c642569163a157fa8a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 08:14:52,534 INFO [StoreOpener-8693ba88cfdbde5de1a79fca2fae875c-1] regionserver.HStore(310): Store=8693ba88cfdbde5de1a79fca2fae875c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 08:14:52,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testConsecutiveExports/2a33bf1b9115e3c642569163a157fa8a 2023-07-12 08:14:52,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testConsecutiveExports/8693ba88cfdbde5de1a79fca2fae875c 2023-07-12 08:14:52,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testConsecutiveExports/2a33bf1b9115e3c642569163a157fa8a 2023-07-12 08:14:52,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testConsecutiveExports/8693ba88cfdbde5de1a79fca2fae875c 2023-07-12 08:14:52,538 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2a33bf1b9115e3c642569163a157fa8a 2023-07-12 08:14:52,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8693ba88cfdbde5de1a79fca2fae875c 2023-07-12 08:14:52,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testConsecutiveExports/2a33bf1b9115e3c642569163a157fa8a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 08:14:52,541 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2a33bf1b9115e3c642569163a157fa8a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65520239, jitterRate=-0.023672357201576233}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 08:14:52,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testConsecutiveExports/8693ba88cfdbde5de1a79fca2fae875c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 08:14:52,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2a33bf1b9115e3c642569163a157fa8a: 2023-07-12 08:14:52,541 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8693ba88cfdbde5de1a79fca2fae875c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63315481, jitterRate=-0.056525811553001404}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 08:14:52,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8693ba88cfdbde5de1a79fca2fae875c: 2023-07-12 08:14:52,542 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689149692115.2a33bf1b9115e3c642569163a157fa8a., pid=46, masterSystemTime=1689149692519 2023-07-12 08:14:52,542 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689149692115.8693ba88cfdbde5de1a79fca2fae875c., pid=45, masterSystemTime=1689149692518 2023-07-12 08:14:52,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689149692115.2a33bf1b9115e3c642569163a157fa8a. 2023-07-12 08:14:52,544 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689149692115.2a33bf1b9115e3c642569163a157fa8a. 2023-07-12 08:14:52,545 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=2a33bf1b9115e3c642569163a157fa8a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:52,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689149692115.8693ba88cfdbde5de1a79fca2fae875c. 2023-07-12 08:14:52,545 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689149692115.2a33bf1b9115e3c642569163a157fa8a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689149692544"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689149692544"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689149692544"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689149692544"}]},"ts":"1689149692544"} 2023-07-12 08:14:52,545 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689149692115.8693ba88cfdbde5de1a79fca2fae875c. 2023-07-12 08:14:52,546 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=8693ba88cfdbde5de1a79fca2fae875c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:52,546 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689149692115.8693ba88cfdbde5de1a79fca2fae875c.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689149692545"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689149692545"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689149692545"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689149692545"}]},"ts":"1689149692545"} 2023-07-12 08:14:52,550 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=44 2023-07-12 08:14:52,550 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 2a33bf1b9115e3c642569163a157fa8a, server=jenkins-hbase4.apache.org,43131,1689149646833 in 180 msec 2023-07-12 08:14:52,551 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-07-12 08:14:52,551 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 8693ba88cfdbde5de1a79fca2fae875c, server=jenkins-hbase4.apache.org,43719,1689149646718 in 182 msec 2023-07-12 08:14:52,551 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=2a33bf1b9115e3c642569163a157fa8a, ASSIGN in 347 msec 2023-07-12 08:14:52,553 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-12 08:14:52,553 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8693ba88cfdbde5de1a79fca2fae875c, ASSIGN in 348 msec 2023-07-12 08:14:52,554 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 08:14:52,554 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149692554"}]},"ts":"1689149692554"} 2023-07-12 08:14:52,555 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-12 08:14:52,558 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 08:14:52,558 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-12 08:14:52,560 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46655] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-12 08:14:52,561 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:14:52,562 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:14:52,562 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:14:52,561 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:14:52,563 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-12 08:14:52,563 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-12 08:14:52,563 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-12 08:14:52,563 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-12 08:14:52,565 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 447 msec 2023-07-12 08:14:52,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-12 08:14:52,731 INFO [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-12 08:14:52,731 DEBUG [Listener at jenkins-hbase4.apache.org/39391] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testConsecutiveExports get assigned. Timeout = 60000ms 2023-07-12 08:14:52,732 INFO [Listener at jenkins-hbase4.apache.org/39391] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 08:14:52,735 INFO [Listener at jenkins-hbase4.apache.org/39391] hbase.HBaseTestingUtility(3484): All regions for table testtb-testConsecutiveExports assigned to meta. Checking AM states. 2023-07-12 08:14:52,735 INFO [Listener at jenkins-hbase4.apache.org/39391] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 08:14:52,735 INFO [Listener at jenkins-hbase4.apache.org/39391] hbase.HBaseTestingUtility(3504): All regions for table testtb-testConsecutiveExports assigned. 2023-07-12 08:14:52,738 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 08:14:52,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689149692738 (current time:1689149692738). 2023-07-12 08:14:52,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 08:14:52,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] zookeeper.ReadOnlyZKClient(139): Connect 0x2f8c02c7 to 127.0.0.1:54842 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:14:52,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7deeb9da, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:14:52,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:14:52,750 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44326, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:14:52,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2f8c02c7 to 127.0.0.1:54842 2023-07-12 08:14:52,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:14:52,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] zookeeper.ReadOnlyZKClient(139): Connect 0x00e63161 to 127.0.0.1:54842 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:14:52,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4fb38180, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:14:52,759 DEBUG [hconnection-0x471bc1c5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:14:52,761 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44342, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:14:52,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:14:52,767 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50610, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:14:52,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x00e63161 to 127.0.0.1:54842 2023-07-12 08:14:52,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:14:52,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-12 08:14:52,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 08:14:52,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 08:14:52,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 08:14:52,773 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 08:14:52,773 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689150292773 2023-07-12 08:14:52,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 08:14:52,773 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-12 08:14:52,775 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 08:14:52,775 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 08:14:52,776 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 08:14:52,776 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 08:14:52,778 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-07-12 08:14:52,778 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 08:14:52,779 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689150292779 2023-07-12 08:14:52,792 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,792 INFO [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-12 08:14:52,792 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:14:52,794 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-12 08:14:52,794 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-12 08:14:52,794 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,794 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,796 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:52,796 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:52,796 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:52,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:52,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:52,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:52,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:52,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:52,796 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:52,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:52,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,797 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:52,797 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:52,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,797 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,797 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,798 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:52,798 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 08:14:52,798 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-12 08:14:52,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-12 08:14:52,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,798 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 08:14:52,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-12 08:14:52,798 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 08:14:52,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,799 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,799 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 08:14:52,799 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 08:14:52,799 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:14:52,801 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 08:14:52,801 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-12 08:14:52,801 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43719,1689149646718' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-12 08:14:52,801 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,801 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,801 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 08:14:52,801 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 08:14:52,801 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:14:52,801 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:14:52,803 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 08:14:52,803 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-12 08:14:52,803 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46655,1689149646904' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-12 08:14:52,806 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 08:14:52,806 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-12 08:14:52,807 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43131,1689149646833' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-12 08:14:52,807 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:52,807 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:52,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:52,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:52,808 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,808 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:52,809 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:14:52,809 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:52,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:52,809 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,809 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,809 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:14:52,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,810 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,810 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:14:52,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:52,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:52,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:52,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:52,811 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43719,1689149646718' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-12 08:14:52,811 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@35018e62[Count = 1] remaining members to acquire global barrier 2023-07-12 08:14:52,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:52,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:52,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:52,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:52,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:52,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:52,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:52,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:52,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:52,813 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43131,1689149646833' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-12 08:14:52,813 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@35018e62[Count = 0] remaining members to acquire global barrier 2023-07-12 08:14:52,813 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-12 08:14:52,813 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,816 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,816 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,816 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,816 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 08:14:52,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,816 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:52,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,816 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 08:14:52,816 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 08:14:52,816 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-12 08:14:52,816 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,46655,1689149646904' in zk 2023-07-12 08:14:52,816 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:52,816 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 08:14:52,818 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 08:14:52,818 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 08:14:52,819 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689149692115.2a33bf1b9115e3c642569163a157fa8a. 2023-07-12 08:14:52,819 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 08:14:52,819 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 08:14:52,819 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689149692115.8693ba88cfdbde5de1a79fca2fae875c. 2023-07-12 08:14:52,819 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689149692115.2a33bf1b9115e3c642569163a157fa8a. started... 2023-07-12 08:14:52,819 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689149692115.8693ba88cfdbde5de1a79fca2fae875c. started... 2023-07-12 08:14:52,821 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2a33bf1b9115e3c642569163a157fa8a: 2023-07-12 08:14:52,821 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8693ba88cfdbde5de1a79fca2fae875c: 2023-07-12 08:14:52,821 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689149692115.2a33bf1b9115e3c642569163a157fa8a.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,822 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 08:14:52,822 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689149692115.8693ba88cfdbde5de1a79fca2fae875c.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,822 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 08:14:52,822 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 08:14:52,822 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 08:14:52,823 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 08:14:52,823 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:14:52,823 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-12 08:14:52,839 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689149692115.2a33bf1b9115e3c642569163a157fa8a. completed. 2023-07-12 08:14:52,839 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689149692115.2a33bf1b9115e3c642569163a157fa8a. 2023-07-12 08:14:52,840 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 08:14:52,840 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 08:14:52,840 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:52,840 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-12 08:14:52,840 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43131,1689149646833' in zk 2023-07-12 08:14:52,841 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:52,841 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 08:14:52,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:52,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:52,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:52,842 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:14:52,842 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-12 08:14:52,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:52,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:52,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:52,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:52,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:52,846 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689149692115.8693ba88cfdbde5de1a79fca2fae875c. completed. 2023-07-12 08:14:52,846 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689149692115.8693ba88cfdbde5de1a79fca2fae875c. 2023-07-12 08:14:52,846 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 08:14:52,846 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 08:14:52,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:52,846 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:52,846 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-12 08:14:52,846 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43719,1689149646718' in zk 2023-07-12 08:14:52,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:52,848 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:52,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:52,848 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 08:14:52,848 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:14:52,848 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-12 08:14:52,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,43131,1689149646833': 2023-07-12 08:14:52,850 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43131,1689149646833' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-12 08:14:52,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:52,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:52,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:52,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:52,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:52,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:52,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:52,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:52,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:52,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:52,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:52,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:52,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,43719,1689149646718': 2023-07-12 08:14:52,853 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43719,1689149646718' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-12 08:14:52,853 INFO [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-12 08:14:52,853 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 08:14:52,853 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 08:14:52,853 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,853 INFO [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 08:14:52,857 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,857 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,857 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:52,857 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,857 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:52,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,857 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,857 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:52,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:52,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:52,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:52,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:52,858 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:52,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:52,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:52,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:52,858 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:52,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:52,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:52,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,859 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:52,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:52,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:52,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:52,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:52,861 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:52,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:52,861 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:52,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,862 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:52,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:52,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:52,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:52,865 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:52,865 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,865 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:52,865 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:52,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:52,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:52,865 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:52,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:52,865 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:14:52,865 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:52,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:52,865 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:52,865 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:52,867 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:52,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:52,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:52,865 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:52,867 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,867 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,867 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:52,867 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:52,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:52,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:52,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:52,867 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:52,867 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:52,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:52,867 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:52,867 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,867 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,868 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,875 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:14:52,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-12 08:14:52,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-12 08:14:52,877 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 08:14:52,890 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,909 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-12 08:14:52,909 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,910 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:52,910 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689149692774Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689149692867 (+93 ms)Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689149692867Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689149692871 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689149692884 (+13 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689149692909 (+25 ms) 2023-07-12 08:14:52,915 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 08:14:52,917 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 140 msec 2023-07-12 08:14:53,077 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:14:53,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-12 08:14:53,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 08:14:53,086 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43719] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689149692115.8693ba88cfdbde5de1a79fca2fae875c. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 08:14:53,087 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43131] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689149692115.2a33bf1b9115e3c642569163a157fa8a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 08:14:53,091 DEBUG [Listener at jenkins-hbase4.apache.org/39391] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-12 08:14:53,091 DEBUG [Listener at jenkins-hbase4.apache.org/39391] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689149692115.8693ba88cfdbde5de1a79fca2fae875c. 2023-07-12 08:14:53,091 INFO [Listener at jenkins-hbase4.apache.org/39391] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 08:14:53,104 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 08:14:53,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689149693104 (current time:1689149693104). 2023-07-12 08:14:53,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 08:14:53,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] zookeeper.ReadOnlyZKClient(139): Connect 0x1776affb to 127.0.0.1:54842 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:14:53,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f8be094, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:14:53,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:14:53,118 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44346, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:14:53,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1776affb to 127.0.0.1:54842 2023-07-12 08:14:53,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:14:53,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] zookeeper.ReadOnlyZKClient(139): Connect 0x517d5179 to 127.0.0.1:54842 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:14:53,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@735625da, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:14:53,127 DEBUG [hconnection-0x3a9e464-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:14:53,129 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44350, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:14:53,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:14:53,133 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50624, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:14:53,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x517d5179 to 127.0.0.1:54842 2023-07-12 08:14:53,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:14:53,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-12 08:14:53,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 08:14:53,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 08:14:53,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 08:14:53,139 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 08:14:53,139 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689150293139 2023-07-12 08:14:53,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 08:14:53,140 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-12 08:14:53,141 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 08:14:53,141 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 08:14:53,142 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 08:14:53,142 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 08:14:53,144 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-07-12 08:14:53,144 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 08:14:53,145 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689150293145 2023-07-12 08:14:53,159 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-12 08:14:53,159 INFO [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-12 08:14:53,159 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:14:53,161 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-12 08:14:53,161 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-12 08:14:53,238 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 08:14:53,238 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 08:14:53,239 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:53,239 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:53,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:53,239 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:53,239 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:53,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:53,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:53,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:53,239 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:53,240 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:53,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:53,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:53,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 08:14:53,240 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:53,240 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 08:14:53,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 08:14:53,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 08:14:53,240 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 08:14:53,240 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 08:14:53,240 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 08:14:53,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-12 08:14:53,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 08:14:53,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-12 08:14:53,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-12 08:14:53,241 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 08:14:53,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 08:14:53,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 08:14:53,241 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:14:53,241 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-12 08:14:53,241 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 08:14:53,241 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 08:14:53,241 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:14:53,242 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-12 08:14:53,242 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 08:14:53,243 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 08:14:53,243 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:14:53,243 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 08:14:53,244 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-12 08:14:53,244 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43719,1689149646718' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-12 08:14:53,245 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 08:14:53,245 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-12 08:14:53,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-12 08:14:53,245 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 08:14:53,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-12 08:14:53,245 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-12 08:14:53,245 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46655,1689149646904' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-12 08:14:53,245 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:14:53,246 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 08:14:53,247 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 08:14:53,247 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-12 08:14:53,247 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43131,1689149646833' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-12 08:14:53,248 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:53,248 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 08:14:53,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:53,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:53,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:53,249 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 08:14:53,249 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 08:14:53,249 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:14:53,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:53,251 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 08:14:53,251 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 08:14:53,251 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:53,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:53,251 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:14:53,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 08:14:53,251 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 08:14:53,251 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:14:53,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:53,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:53,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:53,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:53,253 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43719,1689149646718' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-12 08:14:53,253 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d8bd6cb[Count = 1] remaining members to acquire global barrier 2023-07-12 08:14:53,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:53,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:53,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:53,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:53,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:53,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 08:14:53,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:53,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:53,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:53,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:53,255 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43131,1689149646833' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-12 08:14:53,255 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d8bd6cb[Count = 0] remaining members to acquire global barrier 2023-07-12 08:14:53,255 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-12 08:14:53,255 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 08:14:53,257 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 08:14:53,257 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 08:14:53,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 08:14:53,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 08:14:53,257 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 08:14:53,257 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 08:14:53,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 08:14:53,257 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:53,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 08:14:53,257 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 08:14:53,257 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 08:14:53,257 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689149692115.2a33bf1b9115e3c642569163a157fa8a. 2023-07-12 08:14:53,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 08:14:53,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 08:14:53,257 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689149692115.2a33bf1b9115e3c642569163a157fa8a. started... 2023-07-12 08:14:53,257 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 08:14:53,257 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-12 08:14:53,257 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 08:14:53,257 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:53,257 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,46655,1689149646904' in zk 2023-07-12 08:14:53,257 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 08:14:53,258 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 08:14:53,258 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 08:14:53,258 INFO [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2a33bf1b9115e3c642569163a157fa8a 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-07-12 08:14:53,258 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689149692115.8693ba88cfdbde5de1a79fca2fae875c. 2023-07-12 08:14:53,258 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689149692115.8693ba88cfdbde5de1a79fca2fae875c. started... 2023-07-12 08:14:53,258 INFO [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8693ba88cfdbde5de1a79fca2fae875c 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-07-12 08:14:53,260 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 08:14:53,260 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:14:53,260 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-12 08:14:53,288 INFO [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.87 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testConsecutiveExports/2a33bf1b9115e3c642569163a157fa8a/.tmp/cf/78f45c8f4e744bdcaf3942155af74859 2023-07-12 08:14:53,298 INFO [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=400 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testConsecutiveExports/8693ba88cfdbde5de1a79fca2fae875c/.tmp/cf/9495f5f30fa84929817b450b3540ea6a 2023-07-12 08:14:53,307 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testConsecutiveExports/2a33bf1b9115e3c642569163a157fa8a/.tmp/cf/78f45c8f4e744bdcaf3942155af74859 as hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testConsecutiveExports/2a33bf1b9115e3c642569163a157fa8a/cf/78f45c8f4e744bdcaf3942155af74859 2023-07-12 08:14:53,308 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testConsecutiveExports/8693ba88cfdbde5de1a79fca2fae875c/.tmp/cf/9495f5f30fa84929817b450b3540ea6a as hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testConsecutiveExports/8693ba88cfdbde5de1a79fca2fae875c/cf/9495f5f30fa84929817b450b3540ea6a 2023-07-12 08:14:53,315 INFO [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testConsecutiveExports/8693ba88cfdbde5de1a79fca2fae875c/cf/9495f5f30fa84929817b450b3540ea6a, entries=6, sequenceid=6, filesize=5.2 K 2023-07-12 08:14:53,315 INFO [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testConsecutiveExports/2a33bf1b9115e3c642569163a157fa8a/cf/78f45c8f4e744bdcaf3942155af74859, entries=44, sequenceid=6, filesize=7.8 K 2023-07-12 08:14:53,316 INFO [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for 8693ba88cfdbde5de1a79fca2fae875c in 58ms, sequenceid=6, compaction requested=false 2023-07-12 08:14:53,316 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-12 08:14:53,316 INFO [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 2a33bf1b9115e3c642569163a157fa8a in 59ms, sequenceid=6, compaction requested=false 2023-07-12 08:14:53,317 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-12 08:14:53,317 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8693ba88cfdbde5de1a79fca2fae875c: 2023-07-12 08:14:53,318 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2a33bf1b9115e3c642569163a157fa8a: 2023-07-12 08:14:53,318 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689149692115.8693ba88cfdbde5de1a79fca2fae875c.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-12 08:14:53,318 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 08:14:53,318 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testConsecutiveExports/8693ba88cfdbde5de1a79fca2fae875c/cf/9495f5f30fa84929817b450b3540ea6a] hfiles 2023-07-12 08:14:53,318 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689149692115.2a33bf1b9115e3c642569163a157fa8a.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-12 08:14:53,318 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testConsecutiveExports/8693ba88cfdbde5de1a79fca2fae875c/cf/9495f5f30fa84929817b450b3540ea6a for snapshot=snaptb0-testConsecutiveExports 2023-07-12 08:14:53,318 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 08:14:53,319 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testConsecutiveExports/2a33bf1b9115e3c642569163a157fa8a/cf/78f45c8f4e744bdcaf3942155af74859] hfiles 2023-07-12 08:14:53,319 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testConsecutiveExports/2a33bf1b9115e3c642569163a157fa8a/cf/78f45c8f4e744bdcaf3942155af74859 for snapshot=snaptb0-testConsecutiveExports 2023-07-12 08:14:53,339 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689149692115.2a33bf1b9115e3c642569163a157fa8a. completed. 2023-07-12 08:14:53,339 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689149692115.2a33bf1b9115e3c642569163a157fa8a. 2023-07-12 08:14:53,343 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 08:14:53,343 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 08:14:53,343 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:53,343 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-12 08:14:53,343 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43131,1689149646833' in zk 2023-07-12 08:14:53,345 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 08:14:53,345 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:53,345 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:14:53,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:53,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:53,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:53,345 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-12 08:14:53,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:53,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:53,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 08:14:53,348 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689149692115.8693ba88cfdbde5de1a79fca2fae875c. completed. 2023-07-12 08:14:53,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:53,348 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689149692115.8693ba88cfdbde5de1a79fca2fae875c. 2023-07-12 08:14:53,348 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 08:14:53,348 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 08:14:53,348 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:53,348 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-12 08:14:53,349 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43719,1689149646718' in zk 2023-07-12 08:14:53,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:53,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:53,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:53,351 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:53,351 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 08:14:53,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 08:14:53,351 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:14:53,352 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-12 08:14:53,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:53,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:53,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:53,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,43131,1689149646833': 2023-07-12 08:14:53,354 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43131,1689149646833' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-12 08:14:53,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:53,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:53,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:53,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:53,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:53,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 08:14:53,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:53,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:53,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:53,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:53,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 08:14:53,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:53,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:53,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:53,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,43719,1689149646718': 2023-07-12 08:14:53,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43719,1689149646718' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-12 08:14:53,357 INFO [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-12 08:14:53,357 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 08:14:53,357 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 08:14:53,357 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-12 08:14:53,357 INFO [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 08:14:53,359 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 08:14:53,359 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 08:14:53,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 08:14:53,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 08:14:53,360 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:53,359 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 08:14:53,359 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:53,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 08:14:53,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 08:14:53,360 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:53,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 08:14:53,360 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 08:14:53,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 08:14:53,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 08:14:53,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:53,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:53,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:53,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:53,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:53,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:53,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:53,361 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:53,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:53,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 08:14:53,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 08:14:53,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:53,361 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:53,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 08:14:53,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 08:14:53,361 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:53,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:53,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 08:14:53,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:53,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:53,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:53,364 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:53,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:53,364 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:53,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 08:14:53,365 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:53,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:53,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:53,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:53,371 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:53,371 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:53,371 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:53,371 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 08:14:53,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:53,371 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:14:53,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:53,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:53,371 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:53,371 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-12 08:14:53,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:53,371 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:53,373 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:53,371 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:53,371 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:53,373 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:53,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:53,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:53,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:53,373 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-12 08:14:53,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:53,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:53,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:53,373 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 08:14:53,373 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:14:53,374 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 08:14:53,374 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:14:53,374 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:14:53,374 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 08:14:53,374 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 08:14:53,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:53,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:53,374 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 08:14:53,412 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 08:14:53,436 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-12 08:14:53,436 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 08:14:53,436 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 08:14:53,436 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689149693140Consolidate snapshot: snaptb0-testConsecutiveExports at 1689149693373 (+233 ms)Loading Region manifests for snaptb0-testConsecutiveExports at 1689149693373Writing data manifest for snaptb0-testConsecutiveExports at 1689149693379 (+6 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689149693404 (+25 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689149693436 (+32 ms) 2023-07-12 08:14:53,439 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 08:14:53,441 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 298 msec 2023-07-12 08:14:53,447 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:14:53,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-12 08:14:53,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 08:14:53,448 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/local-export-1689149693448 2023-07-12 08:14:53,448 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/local-export-1689149693448, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/local-export-1689149693448, srcFsUri=hdfs://localhost:34597, srcDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4 2023-07-12 08:14:53,471 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34597, inputRoot=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4 2023-07-12 08:14:53,471 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@6f6355b0, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/local-export-1689149693448, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/local-export-1689149693448/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 08:14:53,471 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34597, inputRoot=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4, snapshotDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-12 08:14:53,478 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/local-export-1689149693448/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 08:14:53,490 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:53,491 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:53,491 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:53,491 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:54,445 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/hadoop-4323600624973610514.jar 2023-07-12 08:14:54,445 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:54,445 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:54,514 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/hadoop-7353988060706403769.jar 2023-07-12 08:14:54,515 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:54,515 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:54,515 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:54,516 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:54,516 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:54,516 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:54,517 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 08:14:54,517 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 08:14:54,518 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 08:14:54,518 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 08:14:54,518 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 08:14:54,519 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 08:14:54,519 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 08:14:54,519 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 08:14:54,520 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 08:14:54,520 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 08:14:54,521 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 08:14:54,521 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 08:14:54,522 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 08:14:54,522 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 08:14:54,523 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 08:14:54,523 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 08:14:54,524 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 08:14:54,955 WARN [Listener at jenkins-hbase4.apache.org/39391] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 08:14:54,958 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-12 08:14:54,961 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-12 08:14:56,592 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 08:14:56,592 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 08:14:56,596 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656036_0002_000001 (auth:SIMPLE) 2023-07-12 08:14:57,320 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656036_0003_000001 (auth:SIMPLE) 2023-07-12 08:14:57,395 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 08:15:01,653 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656036_0003_000001 (auth:SIMPLE) 2023-07-12 08:15:03,930 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656036_0003_000001 (auth:SIMPLE) 2023-07-12 08:15:06,487 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656036_0003_000001 (auth:SIMPLE) 2023-07-12 08:15:08,181 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 08:15:08,182 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 08:15:08,186 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-12 08:15:08,186 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 08:15:08,187 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 08:15:08,188 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1077208093_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 08:15:08,190 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(367): hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-12 08:15:08,190 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(367): hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-12 08:15:08,190 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@4b35ea89 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/local-export-1689149693448/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/local-export-1689149693448/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 08:15:08,190 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/local-export-1689149693448/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-12 08:15:08,190 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/local-export-1689149693448/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-12 08:15:08,192 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/local-export-1689149693448, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/local-export-1689149693448, srcFsUri=hdfs://localhost:34597, srcDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4 2023-07-12 08:15:08,218 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34597, inputRoot=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4 2023-07-12 08:15:08,218 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@43f3f752, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/local-export-1689149693448, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/local-export-1689149693448/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 08:15:08,218 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34597, inputRoot=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4, snapshotDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-12 08:15:08,234 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/local-export-1689149693448/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 08:15:08,256 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:08,257 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:08,257 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:08,258 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:09,178 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/hadoop-8850853283755535095.jar 2023-07-12 08:15:09,179 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:09,179 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:09,249 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/hadoop-4004200423772959811.jar 2023-07-12 08:15:09,250 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:09,250 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:09,251 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:09,252 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:09,252 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:09,253 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:09,253 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 08:15:09,254 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 08:15:09,254 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 08:15:09,255 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 08:15:09,255 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 08:15:09,255 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 08:15:09,256 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 08:15:09,256 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 08:15:09,256 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 08:15:09,257 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 08:15:09,258 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 08:15:09,258 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 08:15:09,259 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 08:15:09,259 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 08:15:09,259 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 08:15:09,260 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 08:15:09,260 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 08:15:09,682 WARN [Listener at jenkins-hbase4.apache.org/39391] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 08:15:09,684 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-12 08:15:09,686 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-12 08:15:12,667 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 08:15:12,667 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 08:15:12,673 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656036_0003_000001 (auth:SIMPLE) 2023-07-12 08:15:13,606 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656036_0004_000001 (auth:SIMPLE) 2023-07-12 08:15:17,973 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656036_0004_000001 (auth:SIMPLE) 2023-07-12 08:15:20,212 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656036_0004_000001 (auth:SIMPLE) 2023-07-12 08:15:24,916 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 08:15:24,917 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 08:15:24,924 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-12 08:15:24,924 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 08:15:24,924 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 08:15:24,924 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1077208093_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 08:15:24,929 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(367): hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-12 08:15:24,929 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(367): hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-12 08:15:24,929 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@4b35ea89 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/local-export-1689149693448/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/local-export-1689149693448/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 08:15:24,929 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/local-export-1689149693448/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-12 08:15:24,929 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/local-export-1689149693448/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-12 08:15:24,946 INFO [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-12 08:15:24,947 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-12 08:15:24,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-12 08:15:24,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-12 08:15:24,957 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149724957"}]},"ts":"1689149724957"} 2023-07-12 08:15:24,959 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-12 08:15:24,960 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-12 08:15:24,962 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8693ba88cfdbde5de1a79fca2fae875c, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=2a33bf1b9115e3c642569163a157fa8a, UNASSIGN}] 2023-07-12 08:15:24,965 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8693ba88cfdbde5de1a79fca2fae875c, UNASSIGN 2023-07-12 08:15:24,965 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=2a33bf1b9115e3c642569163a157fa8a, UNASSIGN 2023-07-12 08:15:24,971 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=8693ba88cfdbde5de1a79fca2fae875c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:24,971 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=2a33bf1b9115e3c642569163a157fa8a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:24,971 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689149692115.8693ba88cfdbde5de1a79fca2fae875c.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689149724971"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149724971"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149724971"}]},"ts":"1689149724971"} 2023-07-12 08:15:24,971 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689149692115.2a33bf1b9115e3c642569163a157fa8a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689149724971"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149724971"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149724971"}]},"ts":"1689149724971"} 2023-07-12 08:15:24,973 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 8693ba88cfdbde5de1a79fca2fae875c, server=jenkins-hbase4.apache.org,43719,1689149646718}] 2023-07-12 08:15:24,974 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 2a33bf1b9115e3c642569163a157fa8a, server=jenkins-hbase4.apache.org,43131,1689149646833}] 2023-07-12 08:15:25,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-12 08:15:25,129 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2a33bf1b9115e3c642569163a157fa8a 2023-07-12 08:15:25,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2a33bf1b9115e3c642569163a157fa8a, disabling compactions & flushes 2023-07-12 08:15:25,129 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689149692115.2a33bf1b9115e3c642569163a157fa8a. 2023-07-12 08:15:25,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689149692115.2a33bf1b9115e3c642569163a157fa8a. 2023-07-12 08:15:25,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689149692115.2a33bf1b9115e3c642569163a157fa8a. after waiting 0 ms 2023-07-12 08:15:25,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689149692115.2a33bf1b9115e3c642569163a157fa8a. 2023-07-12 08:15:25,130 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8693ba88cfdbde5de1a79fca2fae875c 2023-07-12 08:15:25,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8693ba88cfdbde5de1a79fca2fae875c, disabling compactions & flushes 2023-07-12 08:15:25,131 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689149692115.8693ba88cfdbde5de1a79fca2fae875c. 2023-07-12 08:15:25,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689149692115.8693ba88cfdbde5de1a79fca2fae875c. 2023-07-12 08:15:25,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689149692115.8693ba88cfdbde5de1a79fca2fae875c. after waiting 0 ms 2023-07-12 08:15:25,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689149692115.8693ba88cfdbde5de1a79fca2fae875c. 2023-07-12 08:15:25,243 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testConsecutiveExports/8693ba88cfdbde5de1a79fca2fae875c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 08:15:25,243 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testConsecutiveExports/2a33bf1b9115e3c642569163a157fa8a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 08:15:25,243 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 08:15:25,245 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689149692115.8693ba88cfdbde5de1a79fca2fae875c. 2023-07-12 08:15:25,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8693ba88cfdbde5de1a79fca2fae875c: 2023-07-12 08:15:25,246 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 08:15:25,247 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689149692115.2a33bf1b9115e3c642569163a157fa8a. 2023-07-12 08:15:25,248 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2a33bf1b9115e3c642569163a157fa8a: 2023-07-12 08:15:25,250 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8693ba88cfdbde5de1a79fca2fae875c 2023-07-12 08:15:25,252 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=8693ba88cfdbde5de1a79fca2fae875c, regionState=CLOSED 2023-07-12 08:15:25,252 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689149692115.8693ba88cfdbde5de1a79fca2fae875c.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689149725252"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149725252"}]},"ts":"1689149725252"} 2023-07-12 08:15:25,254 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2a33bf1b9115e3c642569163a157fa8a 2023-07-12 08:15:25,254 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=2a33bf1b9115e3c642569163a157fa8a, regionState=CLOSED 2023-07-12 08:15:25,254 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689149692115.2a33bf1b9115e3c642569163a157fa8a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689149725254"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149725254"}]},"ts":"1689149725254"} 2023-07-12 08:15:25,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-12 08:15:25,259 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=52 2023-07-12 08:15:25,259 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 8693ba88cfdbde5de1a79fca2fae875c, server=jenkins-hbase4.apache.org,43719,1689149646718 in 282 msec 2023-07-12 08:15:25,267 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=53 2023-07-12 08:15:25,267 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 2a33bf1b9115e3c642569163a157fa8a, server=jenkins-hbase4.apache.org,43131,1689149646833 in 283 msec 2023-07-12 08:15:25,268 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8693ba88cfdbde5de1a79fca2fae875c, UNASSIGN in 297 msec 2023-07-12 08:15:25,271 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-12 08:15:25,271 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=2a33bf1b9115e3c642569163a157fa8a, UNASSIGN in 305 msec 2023-07-12 08:15:25,272 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149725272"}]},"ts":"1689149725272"} 2023-07-12 08:15:25,274 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-12 08:15:25,275 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-12 08:15:25,278 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 329 msec 2023-07-12 08:15:25,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-12 08:15:25,561 INFO [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-12 08:15:25,562 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-12 08:15:25,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 08:15:25,566 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 08:15:25,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-12 08:15:25,567 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 08:15:25,571 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46655] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-12 08:15:25,576 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testConsecutiveExports/8693ba88cfdbde5de1a79fca2fae875c 2023-07-12 08:15:25,577 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 08:15:25,577 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 08:15:25,577 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 08:15:25,577 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 08:15:25,578 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-12 08:15:25,579 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 08:15:25,579 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:15:25,579 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:15:25,579 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-07-12 08:15:25,579 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-12 08:15:25,579 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-07-12 08:15:25,579 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-12 08:15:25,579 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:15:25,579 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:15:25,580 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-07-12 08:15:25,580 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-12 08:15:25,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-12 08:15:25,587 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testConsecutiveExports/2a33bf1b9115e3c642569163a157fa8a 2023-07-12 08:15:25,588 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testConsecutiveExports/8693ba88cfdbde5de1a79fca2fae875c/cf, FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testConsecutiveExports/8693ba88cfdbde5de1a79fca2fae875c/recovered.edits] 2023-07-12 08:15:25,591 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testConsecutiveExports/2a33bf1b9115e3c642569163a157fa8a/cf, FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testConsecutiveExports/2a33bf1b9115e3c642569163a157fa8a/recovered.edits] 2023-07-12 08:15:25,594 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testConsecutiveExports/8693ba88cfdbde5de1a79fca2fae875c/cf/9495f5f30fa84929817b450b3540ea6a to hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/archive/data/default/testtb-testConsecutiveExports/8693ba88cfdbde5de1a79fca2fae875c/cf/9495f5f30fa84929817b450b3540ea6a 2023-07-12 08:15:25,602 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testConsecutiveExports/8693ba88cfdbde5de1a79fca2fae875c/recovered.edits/9.seqid to hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/archive/data/default/testtb-testConsecutiveExports/8693ba88cfdbde5de1a79fca2fae875c/recovered.edits/9.seqid 2023-07-12 08:15:25,603 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testConsecutiveExports/8693ba88cfdbde5de1a79fca2fae875c 2023-07-12 08:15:25,608 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testConsecutiveExports/2a33bf1b9115e3c642569163a157fa8a/cf/78f45c8f4e744bdcaf3942155af74859 to hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/archive/data/default/testtb-testConsecutiveExports/2a33bf1b9115e3c642569163a157fa8a/cf/78f45c8f4e744bdcaf3942155af74859 2023-07-12 08:15:25,613 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testConsecutiveExports/2a33bf1b9115e3c642569163a157fa8a/recovered.edits/9.seqid to hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/archive/data/default/testtb-testConsecutiveExports/2a33bf1b9115e3c642569163a157fa8a/recovered.edits/9.seqid 2023-07-12 08:15:25,613 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testConsecutiveExports/2a33bf1b9115e3c642569163a157fa8a 2023-07-12 08:15:25,613 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-12 08:15:25,617 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 08:15:25,625 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-12 08:15:25,628 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-12 08:15:25,629 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 08:15:25,629 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-12 08:15:25,629 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689149692115.8693ba88cfdbde5de1a79fca2fae875c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689149725629"}]},"ts":"9223372036854775807"} 2023-07-12 08:15:25,629 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689149692115.2a33bf1b9115e3c642569163a157fa8a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689149725629"}]},"ts":"9223372036854775807"} 2023-07-12 08:15:25,632 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 08:15:25,632 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 8693ba88cfdbde5de1a79fca2fae875c, NAME => 'testtb-testConsecutiveExports,,1689149692115.8693ba88cfdbde5de1a79fca2fae875c.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 2a33bf1b9115e3c642569163a157fa8a, NAME => 'testtb-testConsecutiveExports,1,1689149692115.2a33bf1b9115e3c642569163a157fa8a.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 08:15:25,632 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-12 08:15:25,633 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689149725632"}]},"ts":"9223372036854775807"} 2023-07-12 08:15:25,639 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-12 08:15:25,641 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 08:15:25,643 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 79 msec 2023-07-12 08:15:25,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-12 08:15:25,682 INFO [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-12 08:15:25,694 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-12 08:15:25,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-12 08:15:25,698 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-12 08:15:25,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-12 08:15:25,727 INFO [Listener at jenkins-hbase4.apache.org/39391] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=747 (was 769), OpenFileDescriptor=895 (was 925), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=459 (was 396) - SystemLoadAverage LEAK? -, ProcessCount=180 (was 182), AvailableMemoryMB=3407 (was 2692) - AvailableMemoryMB LEAK? - 2023-07-12 08:15:25,728 WARN [Listener at jenkins-hbase4.apache.org/39391] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-07-12 08:15:25,753 INFO [Listener at jenkins-hbase4.apache.org/39391] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=747, OpenFileDescriptor=895, MaxFileDescriptor=60000, SystemLoadAverage=459, ProcessCount=180, AvailableMemoryMB=3402 2023-07-12 08:15:25,753 WARN [Listener at jenkins-hbase4.apache.org/39391] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-07-12 08:15:25,755 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 08:15:25,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:25,759 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 08:15:25,759 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-12 08:15:25,760 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 08:15:25,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-12 08:15:25,764 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9187b98ec5e47962cb2f0c29fa32a225 2023-07-12 08:15:25,767 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9187b98ec5e47962cb2f0c29fa32a225 empty. 2023-07-12 08:15:25,767 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/170147a1523012eba3d772ffd64021c1 2023-07-12 08:15:25,768 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9187b98ec5e47962cb2f0c29fa32a225 2023-07-12 08:15:25,768 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/170147a1523012eba3d772ffd64021c1 empty. 2023-07-12 08:15:25,768 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/170147a1523012eba3d772ffd64021c1 2023-07-12 08:15:25,768 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-12 08:15:25,806 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-12 08:15:25,807 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9187b98ec5e47962cb2f0c29fa32a225, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689149725754.9187b98ec5e47962cb2f0c29fa32a225.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp 2023-07-12 08:15:25,808 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 170147a1523012eba3d772ffd64021c1, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689149725754.170147a1523012eba3d772ffd64021c1.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp 2023-07-12 08:15:25,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-12 08:15:25,864 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689149725754.9187b98ec5e47962cb2f0c29fa32a225.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:15:25,865 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 9187b98ec5e47962cb2f0c29fa32a225, disabling compactions & flushes 2023-07-12 08:15:25,865 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689149725754.9187b98ec5e47962cb2f0c29fa32a225. 2023-07-12 08:15:25,865 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689149725754.9187b98ec5e47962cb2f0c29fa32a225. 2023-07-12 08:15:25,865 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689149725754.9187b98ec5e47962cb2f0c29fa32a225. after waiting 0 ms 2023-07-12 08:15:25,865 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689149725754.9187b98ec5e47962cb2f0c29fa32a225. 2023-07-12 08:15:25,865 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689149725754.9187b98ec5e47962cb2f0c29fa32a225. 2023-07-12 08:15:25,865 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 9187b98ec5e47962cb2f0c29fa32a225: 2023-07-12 08:15:25,867 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689149725754.170147a1523012eba3d772ffd64021c1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:15:25,867 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 170147a1523012eba3d772ffd64021c1, disabling compactions & flushes 2023-07-12 08:15:25,867 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689149725754.170147a1523012eba3d772ffd64021c1. 2023-07-12 08:15:25,867 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689149725754.170147a1523012eba3d772ffd64021c1. 2023-07-12 08:15:25,867 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689149725754.170147a1523012eba3d772ffd64021c1. after waiting 0 ms 2023-07-12 08:15:25,867 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689149725754.170147a1523012eba3d772ffd64021c1. 2023-07-12 08:15:25,867 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689149725754.170147a1523012eba3d772ffd64021c1. 2023-07-12 08:15:25,868 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 170147a1523012eba3d772ffd64021c1: 2023-07-12 08:15:25,871 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 08:15:25,872 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689149725754.9187b98ec5e47962cb2f0c29fa32a225.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689149725872"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149725872"}]},"ts":"1689149725872"} 2023-07-12 08:15:25,872 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689149725754.170147a1523012eba3d772ffd64021c1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689149725872"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149725872"}]},"ts":"1689149725872"} 2023-07-12 08:15:25,880 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 08:15:25,881 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 08:15:25,881 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149725881"}]},"ts":"1689149725881"} 2023-07-12 08:15:25,883 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-12 08:15:25,887 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 08:15:25,888 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 08:15:25,888 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 08:15:25,888 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 08:15:25,888 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 08:15:25,888 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9187b98ec5e47962cb2f0c29fa32a225, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=170147a1523012eba3d772ffd64021c1, ASSIGN}] 2023-07-12 08:15:25,891 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=170147a1523012eba3d772ffd64021c1, ASSIGN 2023-07-12 08:15:25,891 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9187b98ec5e47962cb2f0c29fa32a225, ASSIGN 2023-07-12 08:15:25,892 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=170147a1523012eba3d772ffd64021c1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46655,1689149646904; forceNewPlan=false, retain=false 2023-07-12 08:15:25,892 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9187b98ec5e47962cb2f0c29fa32a225, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43719,1689149646718; forceNewPlan=false, retain=false 2023-07-12 08:15:26,042 INFO [jenkins-hbase4:33919] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 08:15:26,046 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=170147a1523012eba3d772ffd64021c1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:26,046 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=9187b98ec5e47962cb2f0c29fa32a225, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:26,046 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689149725754.170147a1523012eba3d772ffd64021c1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689149726046"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149726046"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149726046"}]},"ts":"1689149726046"} 2023-07-12 08:15:26,046 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689149725754.9187b98ec5e47962cb2f0c29fa32a225.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689149726046"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149726046"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149726046"}]},"ts":"1689149726046"} 2023-07-12 08:15:26,050 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 170147a1523012eba3d772ffd64021c1, server=jenkins-hbase4.apache.org,46655,1689149646904}] 2023-07-12 08:15:26,052 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 9187b98ec5e47962cb2f0c29fa32a225, server=jenkins-hbase4.apache.org,43719,1689149646718}] 2023-07-12 08:15:26,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-12 08:15:26,212 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689149725754.170147a1523012eba3d772ffd64021c1. 2023-07-12 08:15:26,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 170147a1523012eba3d772ffd64021c1, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689149725754.170147a1523012eba3d772ffd64021c1.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 08:15:26,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689149725754.170147a1523012eba3d772ffd64021c1. service=AccessControlService 2023-07-12 08:15:26,213 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 08:15:26,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 170147a1523012eba3d772ffd64021c1 2023-07-12 08:15:26,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689149725754.170147a1523012eba3d772ffd64021c1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:15:26,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 170147a1523012eba3d772ffd64021c1 2023-07-12 08:15:26,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 170147a1523012eba3d772ffd64021c1 2023-07-12 08:15:26,216 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689149725754.9187b98ec5e47962cb2f0c29fa32a225. 2023-07-12 08:15:26,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9187b98ec5e47962cb2f0c29fa32a225, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689149725754.9187b98ec5e47962cb2f0c29fa32a225.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 08:15:26,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689149725754.9187b98ec5e47962cb2f0c29fa32a225. service=AccessControlService 2023-07-12 08:15:26,216 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 08:15:26,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 9187b98ec5e47962cb2f0c29fa32a225 2023-07-12 08:15:26,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689149725754.9187b98ec5e47962cb2f0c29fa32a225.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:15:26,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9187b98ec5e47962cb2f0c29fa32a225 2023-07-12 08:15:26,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9187b98ec5e47962cb2f0c29fa32a225 2023-07-12 08:15:26,223 INFO [StoreOpener-170147a1523012eba3d772ffd64021c1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 170147a1523012eba3d772ffd64021c1 2023-07-12 08:15:26,230 INFO [StoreOpener-9187b98ec5e47962cb2f0c29fa32a225-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9187b98ec5e47962cb2f0c29fa32a225 2023-07-12 08:15:26,231 DEBUG [StoreOpener-170147a1523012eba3d772ffd64021c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion/170147a1523012eba3d772ffd64021c1/cf 2023-07-12 08:15:26,231 DEBUG [StoreOpener-170147a1523012eba3d772ffd64021c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion/170147a1523012eba3d772ffd64021c1/cf 2023-07-12 08:15:26,233 DEBUG [StoreOpener-9187b98ec5e47962cb2f0c29fa32a225-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion/9187b98ec5e47962cb2f0c29fa32a225/cf 2023-07-12 08:15:26,233 DEBUG [StoreOpener-9187b98ec5e47962cb2f0c29fa32a225-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion/9187b98ec5e47962cb2f0c29fa32a225/cf 2023-07-12 08:15:26,233 INFO [StoreOpener-170147a1523012eba3d772ffd64021c1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 170147a1523012eba3d772ffd64021c1 columnFamilyName cf 2023-07-12 08:15:26,234 INFO [StoreOpener-9187b98ec5e47962cb2f0c29fa32a225-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9187b98ec5e47962cb2f0c29fa32a225 columnFamilyName cf 2023-07-12 08:15:26,234 INFO [StoreOpener-170147a1523012eba3d772ffd64021c1-1] regionserver.HStore(310): Store=170147a1523012eba3d772ffd64021c1/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 08:15:26,235 INFO [StoreOpener-9187b98ec5e47962cb2f0c29fa32a225-1] regionserver.HStore(310): Store=9187b98ec5e47962cb2f0c29fa32a225/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 08:15:26,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion/170147a1523012eba3d772ffd64021c1 2023-07-12 08:15:26,236 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion/9187b98ec5e47962cb2f0c29fa32a225 2023-07-12 08:15:26,236 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion/170147a1523012eba3d772ffd64021c1 2023-07-12 08:15:26,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion/9187b98ec5e47962cb2f0c29fa32a225 2023-07-12 08:15:26,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9187b98ec5e47962cb2f0c29fa32a225 2023-07-12 08:15:26,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 170147a1523012eba3d772ffd64021c1 2023-07-12 08:15:26,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion/9187b98ec5e47962cb2f0c29fa32a225/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 08:15:26,256 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9187b98ec5e47962cb2f0c29fa32a225; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64389216, jitterRate=-0.04052591323852539}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 08:15:26,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9187b98ec5e47962cb2f0c29fa32a225: 2023-07-12 08:15:26,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion/170147a1523012eba3d772ffd64021c1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 08:15:26,258 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 170147a1523012eba3d772ffd64021c1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70201404, jitterRate=0.04608243703842163}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 08:15:26,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 170147a1523012eba3d772ffd64021c1: 2023-07-12 08:15:26,258 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689149725754.9187b98ec5e47962cb2f0c29fa32a225., pid=61, masterSystemTime=1689149726208 2023-07-12 08:15:26,259 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689149725754.170147a1523012eba3d772ffd64021c1., pid=60, masterSystemTime=1689149726204 2023-07-12 08:15:26,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689149725754.9187b98ec5e47962cb2f0c29fa32a225. 2023-07-12 08:15:26,260 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689149725754.9187b98ec5e47962cb2f0c29fa32a225. 2023-07-12 08:15:26,261 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=9187b98ec5e47962cb2f0c29fa32a225, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:26,261 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689149725754.9187b98ec5e47962cb2f0c29fa32a225.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689149726261"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689149726261"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689149726261"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689149726261"}]},"ts":"1689149726261"} 2023-07-12 08:15:26,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689149725754.170147a1523012eba3d772ffd64021c1. 2023-07-12 08:15:26,262 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689149725754.170147a1523012eba3d772ffd64021c1. 2023-07-12 08:15:26,263 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=170147a1523012eba3d772ffd64021c1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:26,263 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689149725754.170147a1523012eba3d772ffd64021c1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689149726262"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689149726262"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689149726262"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689149726262"}]},"ts":"1689149726262"} 2023-07-12 08:15:26,274 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-12 08:15:26,274 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-12 08:15:26,274 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 9187b98ec5e47962cb2f0c29fa32a225, server=jenkins-hbase4.apache.org,43719,1689149646718 in 213 msec 2023-07-12 08:15:26,274 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 170147a1523012eba3d772ffd64021c1, server=jenkins-hbase4.apache.org,46655,1689149646904 in 216 msec 2023-07-12 08:15:26,276 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=170147a1523012eba3d772ffd64021c1, ASSIGN in 386 msec 2023-07-12 08:15:26,277 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=57 2023-07-12 08:15:26,277 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9187b98ec5e47962cb2f0c29fa32a225, ASSIGN in 386 msec 2023-07-12 08:15:26,279 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 08:15:26,279 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149726279"}]},"ts":"1689149726279"} 2023-07-12 08:15:26,281 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-12 08:15:26,284 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 08:15:26,285 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-12 08:15:26,288 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46655] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-12 08:15:26,290 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:15:26,290 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:15:26,290 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:15:26,291 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:15:26,294 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 08:15:26,294 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 08:15:26,295 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 08:15:26,295 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 08:15:26,298 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 540 msec 2023-07-12 08:15:26,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-12 08:15:26,366 INFO [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-12 08:15:26,366 DEBUG [Listener at jenkins-hbase4.apache.org/39391] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithMergeRegion get assigned. Timeout = 60000ms 2023-07-12 08:15:26,366 INFO [Listener at jenkins-hbase4.apache.org/39391] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 08:15:26,370 INFO [Listener at jenkins-hbase4.apache.org/39391] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned to meta. Checking AM states. 2023-07-12 08:15:26,370 INFO [Listener at jenkins-hbase4.apache.org/39391] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 08:15:26,371 INFO [Listener at jenkins-hbase4.apache.org/39391] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned. 2023-07-12 08:15:26,374 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 08:15:26,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689149726374 (current time:1689149726374). 2023-07-12 08:15:26,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 08:15:26,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] zookeeper.ReadOnlyZKClient(139): Connect 0x07616903 to 127.0.0.1:54842 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:15:26,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5c49bf83, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:15:26,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:15:26,389 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59184, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:15:26,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x07616903 to 127.0.0.1:54842 2023-07-12 08:15:26,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:15:26,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] zookeeper.ReadOnlyZKClient(139): Connect 0x0d83d3d5 to 127.0.0.1:54842 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:15:26,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1269a17, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:15:26,404 DEBUG [hconnection-0x10828817-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:15:26,405 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59188, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:15:26,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:15:26,413 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37422, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:15:26,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0d83d3d5 to 127.0.0.1:54842 2023-07-12 08:15:26,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:15:26,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-12 08:15:26,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 08:15:26,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 08:15:26,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 08:15:26,419 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 08:15:26,420 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689150326420 2023-07-12 08:15:26,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 08:15:26,420 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,421 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 08:15:26,422 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 08:15:26,423 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 08:15:26,423 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 08:15:26,424 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-07-12 08:15:26,425 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 08:15:26,426 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689150326426 2023-07-12 08:15:26,450 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,450 INFO [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-12 08:15:26,450 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:15:26,452 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-12 08:15:26,452 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-12 08:15:26,452 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,453 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,454 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:26,454 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:26,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:26,454 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:26,454 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:26,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:26,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:26,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:26,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:26,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:26,455 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:26,455 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:26,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,456 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,456 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,456 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,456 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:26,456 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 08:15:26,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-12 08:15:26,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-12 08:15:26,456 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 08:15:26,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-12 08:15:26,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,457 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 08:15:26,457 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 08:15:26,458 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,458 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,458 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 08:15:26,458 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:15:26,458 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,458 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 08:15:26,468 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 08:15:26,468 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:15:26,468 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 08:15:26,468 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:15:26,472 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 08:15:26,474 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 08:15:26,474 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 08:15:26,470 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 08:15:26,474 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43131,1689149646833' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 08:15:26,474 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 08:15:26,474 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46655,1689149646904' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 08:15:26,474 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43719,1689149646718' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 08:15:26,477 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,477 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,478 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:26,478 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:26,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:26,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:15:26,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:15:26,478 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,478 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,478 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:15:26,478 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,478 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:15:26,478 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:15:26,478 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:15:26,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:15:26,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:26,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:26,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:26,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:15:26,487 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43719,1689149646718' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-12 08:15:26,487 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@25a74da3[Count = 1] remaining members to acquire global barrier 2023-07-12 08:15:26,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:26,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:15:26,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:15:26,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:15:26,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:15:26,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:26,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:26,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:26,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:15:26,490 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46655,1689149646904' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-12 08:15:26,490 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@25a74da3[Count = 0] remaining members to acquire global barrier 2023-07-12 08:15:26,490 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-12 08:15:26,491 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,493 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,493 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,495 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,495 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:26,495 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 08:15:26,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,496 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 08:15:26,496 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 08:15:26,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,496 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43131,1689149646833' in zk 2023-07-12 08:15:26,496 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 08:15:26,496 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:26,496 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 08:15:26,500 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 08:15:26,500 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:15:26,500 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 08:15:26,507 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 08:15:26,507 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 08:15:26,507 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 08:15:26,507 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 08:15:26,507 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689149725754.170147a1523012eba3d772ffd64021c1. 2023-07-12 08:15:26,507 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689149725754.170147a1523012eba3d772ffd64021c1. started... 2023-07-12 08:15:26,512 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689149725754.9187b98ec5e47962cb2f0c29fa32a225. 2023-07-12 08:15:26,512 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689149725754.9187b98ec5e47962cb2f0c29fa32a225. started... 2023-07-12 08:15:26,518 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 170147a1523012eba3d772ffd64021c1: 2023-07-12 08:15:26,518 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9187b98ec5e47962cb2f0c29fa32a225: 2023-07-12 08:15:26,519 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689149725754.170147a1523012eba3d772ffd64021c1.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,519 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689149725754.9187b98ec5e47962cb2f0c29fa32a225.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,519 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 08:15:26,519 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 08:15:26,519 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 08:15:26,519 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 08:15:26,522 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:15:26,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 08:15:26,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-12 08:15:26,523 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 08:15:26,563 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689149725754.170147a1523012eba3d772ffd64021c1. completed. 2023-07-12 08:15:26,563 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689149725754.170147a1523012eba3d772ffd64021c1. 2023-07-12 08:15:26,563 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 08:15:26,563 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 08:15:26,563 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:26,563 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 08:15:26,563 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,46655,1689149646904' in zk 2023-07-12 08:15:26,565 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 08:15:26,565 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:26,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:26,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:15:26,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:15:26,565 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:15:26,566 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 08:15:26,572 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689149725754.9187b98ec5e47962cb2f0c29fa32a225. completed. 2023-07-12 08:15:26,572 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689149725754.9187b98ec5e47962cb2f0c29fa32a225. 2023-07-12 08:15:26,572 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 08:15:26,572 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 08:15:26,572 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:26,572 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 08:15:26,573 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43719,1689149646718' in zk 2023-07-12 08:15:26,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:15:26,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:15:26,574 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:26,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:26,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:26,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:26,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:15:26,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:26,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:26,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:26,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,46655,1689149646904': 2023-07-12 08:15:26,578 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46655,1689149646904' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-12 08:15:26,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:26,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:15:26,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:15:26,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:15:26,579 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 08:15:26,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:15:26,579 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:15:26,579 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 08:15:26,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:26,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:26,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:26,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:15:26,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:26,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:26,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:26,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,43719,1689149646718': 2023-07-12 08:15:26,585 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43719,1689149646718' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-12 08:15:26,585 INFO [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-12 08:15:26,585 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 08:15:26,585 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 08:15:26,585 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,585 INFO [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 08:15:26,589 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,589 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,589 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:26,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,589 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:15:26,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:15:26,589 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:26,589 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:26,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:26,590 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:26,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,590 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:26,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:26,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:26,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:15:26,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:26,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:26,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,591 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:26,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,591 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:26,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:15:26,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:26,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:26,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:26,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:15:26,595 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:26,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,595 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:26,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:26,596 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:26,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:26,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:26,599 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:26,599 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:26,599 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:26,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:26,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:26,599 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:26,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:26,599 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,599 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:26,599 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,599 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:26,599 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:15:26,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:26,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:26,599 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:26,599 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:26,599 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:26,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:26,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:26,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:26,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:26,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:26,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:26,601 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,601 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:26,602 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,602 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:26,602 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,602 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:26,602 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:26,602 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,602 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,642 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,724 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:15:26,724 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-12 08:15:26,724 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,725 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,725 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689149726420Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689149726599 (+179 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689149726599Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689149726604 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689149726622 (+18 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689149726724 (+102 ms) 2023-07-12 08:15:26,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 08:15:26,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 08:15:26,728 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 08:15:26,731 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 307 msec 2023-07-12 08:15:26,744 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43719] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689149725754.9187b98ec5e47962cb2f0c29fa32a225. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 08:15:26,745 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46655] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689149725754.170147a1523012eba3d772ffd64021c1. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 08:15:26,749 DEBUG [Listener at jenkins-hbase4.apache.org/39391] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,749 DEBUG [Listener at jenkins-hbase4.apache.org/39391] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689149725754.9187b98ec5e47962cb2f0c29fa32a225. 2023-07-12 08:15:26,749 INFO [Listener at jenkins-hbase4.apache.org/39391] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 08:15:26,771 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 08:15:26,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689149726771 (current time:1689149726771). 2023-07-12 08:15:26,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 08:15:26,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] zookeeper.ReadOnlyZKClient(139): Connect 0x1028da72 to 127.0.0.1:54842 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:15:26,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3e7430df, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:15:26,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:15:26,791 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59194, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:15:26,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1028da72 to 127.0.0.1:54842 2023-07-12 08:15:26,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:15:26,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] zookeeper.ReadOnlyZKClient(139): Connect 0x159caa49 to 127.0.0.1:54842 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:15:26,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@43b109c2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:15:26,809 DEBUG [hconnection-0x5c5c3ba3-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:15:26,812 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59198, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:15:26,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:15:26,819 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37426, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:15:26,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x159caa49 to 127.0.0.1:54842 2023-07-12 08:15:26,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:15:26,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-12 08:15:26,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 08:15:26,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 08:15:26,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 08:15:26,839 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 08:15:26,841 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689150326841 2023-07-12 08:15:26,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 08:15:26,842 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,842 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 08:15:26,842 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 08:15:26,846 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 08:15:26,848 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 08:15:26,848 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 10 msec 2023-07-12 08:15:26,849 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 08:15:26,850 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689150326850 2023-07-12 08:15:26,863 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,864 INFO [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-12 08:15:26,864 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:15:26,865 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-12 08:15:26,865 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-12 08:15:26,866 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,866 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,867 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:26,867 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:26,867 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:26,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:26,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:26,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:26,867 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:26,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:26,867 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:26,867 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:26,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:26,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:26,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,868 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:26,868 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 08:15:26,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,868 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,868 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,868 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-12 08:15:26,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,869 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 08:15:26,869 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-12 08:15:26,869 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 08:15:26,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,869 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:15:26,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-12 08:15:26,870 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 08:15:26,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,870 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 08:15:26,870 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 08:15:26,870 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46655,1689149646904' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 08:15:26,870 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 08:15:26,871 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,871 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 08:15:26,871 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:15:26,871 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,872 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 08:15:26,872 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 08:15:26,872 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 08:15:26,872 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43719,1689149646718' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 08:15:26,872 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:15:26,873 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 08:15:26,873 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 08:15:26,873 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43131,1689149646833' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 08:15:26,873 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:26,873 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:26,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:15:26,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:15:26,873 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,873 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:15:26,875 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,877 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:26,877 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,877 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,877 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:15:26,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:15:26,877 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,877 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:15:26,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:15:26,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:26,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:26,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:26,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:15:26,879 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46655,1689149646904' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-12 08:15:26,879 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3ed49078[Count = 1] remaining members to acquire global barrier 2023-07-12 08:15:26,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:26,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:15:26,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:15:26,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:15:26,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:15:26,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:26,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:26,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:26,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:15:26,881 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43719,1689149646718' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-12 08:15:26,881 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3ed49078[Count = 0] remaining members to acquire global barrier 2023-07-12 08:15:26,881 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-12 08:15:26,881 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,882 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,882 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,882 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,883 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 08:15:26,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,883 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 08:15:26,883 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 08:15:26,883 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:26,883 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 08:15:26,883 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 08:15:26,883 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 08:15:26,883 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689149725754.9187b98ec5e47962cb2f0c29fa32a225. 2023-07-12 08:15:26,883 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43131,1689149646833' in zk 2023-07-12 08:15:26,883 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689149725754.9187b98ec5e47962cb2f0c29fa32a225. started... 2023-07-12 08:15:26,883 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:26,884 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 08:15:26,884 INFO [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9187b98ec5e47962cb2f0c29fa32a225 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-12 08:15:26,885 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 08:15:26,885 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:15:26,885 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 08:15:26,890 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 08:15:26,892 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 08:15:26,892 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689149725754.170147a1523012eba3d772ffd64021c1. 2023-07-12 08:15:26,892 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689149725754.170147a1523012eba3d772ffd64021c1. started... 2023-07-12 08:15:26,892 INFO [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 170147a1523012eba3d772ffd64021c1 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-12 08:15:26,919 INFO [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion/170147a1523012eba3d772ffd64021c1/.tmp/cf/4ec005d70c92434ea24c0772c579643f 2023-07-12 08:15:26,921 INFO [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion/9187b98ec5e47962cb2f0c29fa32a225/.tmp/cf/e2b8adee76724e6f84fb7a460afe54a2 2023-07-12 08:15:26,926 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion/170147a1523012eba3d772ffd64021c1/.tmp/cf/4ec005d70c92434ea24c0772c579643f as hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion/170147a1523012eba3d772ffd64021c1/cf/4ec005d70c92434ea24c0772c579643f 2023-07-12 08:15:26,928 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion/9187b98ec5e47962cb2f0c29fa32a225/.tmp/cf/e2b8adee76724e6f84fb7a460afe54a2 as hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion/9187b98ec5e47962cb2f0c29fa32a225/cf/e2b8adee76724e6f84fb7a460afe54a2 2023-07-12 08:15:26,932 INFO [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion/170147a1523012eba3d772ffd64021c1/cf/4ec005d70c92434ea24c0772c579643f, entries=48, sequenceid=6, filesize=8.1 K 2023-07-12 08:15:26,933 INFO [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 170147a1523012eba3d772ffd64021c1 in 41ms, sequenceid=6, compaction requested=false 2023-07-12 08:15:26,934 INFO [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion/9187b98ec5e47962cb2f0c29fa32a225/cf/e2b8adee76724e6f84fb7a460afe54a2, entries=2, sequenceid=6, filesize=5.0 K 2023-07-12 08:15:26,934 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-12 08:15:26,934 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 170147a1523012eba3d772ffd64021c1: 2023-07-12 08:15:26,934 INFO [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 9187b98ec5e47962cb2f0c29fa32a225 in 50ms, sequenceid=6, compaction requested=false 2023-07-12 08:15:26,936 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9187b98ec5e47962cb2f0c29fa32a225: 2023-07-12 08:15:26,937 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689149725754.170147a1523012eba3d772ffd64021c1.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,937 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 08:15:26,937 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689149725754.9187b98ec5e47962cb2f0c29fa32a225.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,937 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion/170147a1523012eba3d772ffd64021c1/cf/4ec005d70c92434ea24c0772c579643f] hfiles 2023-07-12 08:15:26,937 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 08:15:26,937 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion/170147a1523012eba3d772ffd64021c1/cf/4ec005d70c92434ea24c0772c579643f for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,937 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion/9187b98ec5e47962cb2f0c29fa32a225/cf/e2b8adee76724e6f84fb7a460afe54a2] hfiles 2023-07-12 08:15:26,937 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion/9187b98ec5e47962cb2f0c29fa32a225/cf/e2b8adee76724e6f84fb7a460afe54a2 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,942 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:15:26,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 08:15:26,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-12 08:15:26,944 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 08:15:26,947 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689149725754.9187b98ec5e47962cb2f0c29fa32a225. completed. 2023-07-12 08:15:26,947 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689149725754.9187b98ec5e47962cb2f0c29fa32a225. 2023-07-12 08:15:26,947 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 08:15:26,947 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 08:15:26,947 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:26,947 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 08:15:26,947 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43719,1689149646718' in zk 2023-07-12 08:15:26,949 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 08:15:26,949 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:15:26,949 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:26,949 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 08:15:26,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:26,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:15:26,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:15:26,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:15:26,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:15:26,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:26,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:26,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:26,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:15:26,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:26,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:26,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,43719,1689149646718': 2023-07-12 08:15:26,954 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43719,1689149646718' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-12 08:15:26,955 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689149725754.170147a1523012eba3d772ffd64021c1. completed. 2023-07-12 08:15:26,955 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689149725754.170147a1523012eba3d772ffd64021c1. 2023-07-12 08:15:26,955 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 08:15:26,955 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 08:15:26,955 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:26,955 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 08:15:26,955 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,46655,1689149646904' in zk 2023-07-12 08:15:26,957 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:26,957 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 08:15:26,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:26,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:15:26,958 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:15:26,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:15:26,958 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 08:15:26,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:15:26,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:15:26,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:26,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:26,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:26,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:15:26,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:26,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:26,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:26,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,46655,1689149646904': 2023-07-12 08:15:26,964 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46655,1689149646904' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-12 08:15:26,964 INFO [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-12 08:15:26,964 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 08:15:26,964 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 08:15:26,964 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,964 INFO [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 08:15:26,970 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,970 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,970 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:15:26,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:15:26,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,970 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:26,970 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:26,970 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,970 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:26,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,971 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:26,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:26,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:26,971 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:26,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:26,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:26,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,971 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:26,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:15:26,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:26,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:26,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:15:26,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:26,973 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:26,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:26,974 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:26,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:26,974 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:26,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:15:26,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:26,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:26,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:26,977 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:26,977 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:26,977 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:26,977 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:26,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:26,977 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:26,977 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:26,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:26,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:26,977 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:26,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:26,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:26,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:26,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:26,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:26,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:26,977 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:26,978 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,978 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:15:26,977 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:26,983 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:26,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:26,985 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:26,985 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,985 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:26,985 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,985 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:26,985 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:26,985 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,985 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:26,986 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:27,011 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:27,043 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-12 08:15:27,043 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:27,044 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:27,044 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689149726842Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689149726983 (+141 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689149726985 (+2 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689149726991 (+6 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689149727003 (+12 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689149727043 (+40 ms) 2023-07-12 08:15:27,047 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 08:15:27,049 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 203 msec 2023-07-12 08:15:27,144 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:15:27,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 08:15:27,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 08:15:27,186 DEBUG [Listener at jenkins-hbase4.apache.org/39391] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 08:15:27,193 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59204, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 08:15:27,194 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43131] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-12 08:15:27,196 DEBUG [Listener at jenkins-hbase4.apache.org/39391] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 08:15:27,202 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59818, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 08:15:27,202 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43719] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-12 08:15:27,203 DEBUG [Listener at jenkins-hbase4.apache.org/39391] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 08:15:27,214 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37438, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 08:15:27,214 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46655] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-12 08:15:27,218 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 08:15:27,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:27,223 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 08:15:27,223 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-12 08:15:27,224 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 08:15:27,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-12 08:15:27,229 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85bd114d04bba2a11a8b175ccc866103 2023-07-12 08:15:27,230 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85bd114d04bba2a11a8b175ccc866103 empty. 2023-07-12 08:15:27,231 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0800d3c00f8ae8f2e555ea4c06358216 2023-07-12 08:15:27,231 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85bd114d04bba2a11a8b175ccc866103 2023-07-12 08:15:27,232 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0800d3c00f8ae8f2e555ea4c06358216 empty. 2023-07-12 08:15:27,233 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0800d3c00f8ae8f2e555ea4c06358216 2023-07-12 08:15:27,233 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-12 08:15:27,279 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-12 08:15:27,299 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0800d3c00f8ae8f2e555ea4c06358216, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689149727218.0800d3c00f8ae8f2e555ea4c06358216.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp 2023-07-12 08:15:27,307 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 85bd114d04bba2a11a8b175ccc866103, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689149727218.85bd114d04bba2a11a8b175ccc866103.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp 2023-07-12 08:15:27,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-12 08:15:27,347 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689149727218.0800d3c00f8ae8f2e555ea4c06358216.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:15:27,347 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 0800d3c00f8ae8f2e555ea4c06358216, disabling compactions & flushes 2023-07-12 08:15:27,347 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689149727218.0800d3c00f8ae8f2e555ea4c06358216. 2023-07-12 08:15:27,347 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689149727218.0800d3c00f8ae8f2e555ea4c06358216. 2023-07-12 08:15:27,347 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689149727218.0800d3c00f8ae8f2e555ea4c06358216. after waiting 0 ms 2023-07-12 08:15:27,347 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689149727218.0800d3c00f8ae8f2e555ea4c06358216. 2023-07-12 08:15:27,347 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689149727218.0800d3c00f8ae8f2e555ea4c06358216. 2023-07-12 08:15:27,347 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 0800d3c00f8ae8f2e555ea4c06358216: 2023-07-12 08:15:27,353 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689149727218.85bd114d04bba2a11a8b175ccc866103.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:15:27,353 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 85bd114d04bba2a11a8b175ccc866103, disabling compactions & flushes 2023-07-12 08:15:27,353 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689149727218.85bd114d04bba2a11a8b175ccc866103. 2023-07-12 08:15:27,353 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689149727218.85bd114d04bba2a11a8b175ccc866103. 2023-07-12 08:15:27,353 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689149727218.85bd114d04bba2a11a8b175ccc866103. after waiting 0 ms 2023-07-12 08:15:27,353 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689149727218.85bd114d04bba2a11a8b175ccc866103. 2023-07-12 08:15:27,353 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689149727218.85bd114d04bba2a11a8b175ccc866103. 2023-07-12 08:15:27,353 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 85bd114d04bba2a11a8b175ccc866103: 2023-07-12 08:15:27,356 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 08:15:27,357 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689149727218.0800d3c00f8ae8f2e555ea4c06358216.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689149727357"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149727357"}]},"ts":"1689149727357"} 2023-07-12 08:15:27,357 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689149727218.85bd114d04bba2a11a8b175ccc866103.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689149727357"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149727357"}]},"ts":"1689149727357"} 2023-07-12 08:15:27,359 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 08:15:27,360 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 08:15:27,360 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149727360"}]},"ts":"1689149727360"} 2023-07-12 08:15:27,361 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-12 08:15:27,364 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 08:15:27,365 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 08:15:27,365 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 08:15:27,365 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 08:15:27,365 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 08:15:27,366 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=85bd114d04bba2a11a8b175ccc866103, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0800d3c00f8ae8f2e555ea4c06358216, ASSIGN}] 2023-07-12 08:15:27,368 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0800d3c00f8ae8f2e555ea4c06358216, ASSIGN 2023-07-12 08:15:27,368 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=85bd114d04bba2a11a8b175ccc866103, ASSIGN 2023-07-12 08:15:27,369 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0800d3c00f8ae8f2e555ea4c06358216, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43719,1689149646718; forceNewPlan=false, retain=false 2023-07-12 08:15:27,369 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=85bd114d04bba2a11a8b175ccc866103, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46655,1689149646904; forceNewPlan=false, retain=false 2023-07-12 08:15:27,519 INFO [jenkins-hbase4:33919] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 08:15:27,523 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=0800d3c00f8ae8f2e555ea4c06358216, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:27,523 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=85bd114d04bba2a11a8b175ccc866103, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:27,523 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689149727218.0800d3c00f8ae8f2e555ea4c06358216.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689149727523"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149727523"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149727523"}]},"ts":"1689149727523"} 2023-07-12 08:15:27,523 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689149727218.85bd114d04bba2a11a8b175ccc866103.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689149727523"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149727523"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149727523"}]},"ts":"1689149727523"} 2023-07-12 08:15:27,525 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 0800d3c00f8ae8f2e555ea4c06358216, server=jenkins-hbase4.apache.org,43719,1689149646718}] 2023-07-12 08:15:27,526 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure 85bd114d04bba2a11a8b175ccc866103, server=jenkins-hbase4.apache.org,46655,1689149646904}] 2023-07-12 08:15:27,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-12 08:15:27,682 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689149727218.0800d3c00f8ae8f2e555ea4c06358216. 2023-07-12 08:15:27,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0800d3c00f8ae8f2e555ea4c06358216, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689149727218.0800d3c00f8ae8f2e555ea4c06358216.', STARTKEY => '2', ENDKEY => ''} 2023-07-12 08:15:27,683 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689149727218.85bd114d04bba2a11a8b175ccc866103. 2023-07-12 08:15:27,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 85bd114d04bba2a11a8b175ccc866103, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689149727218.85bd114d04bba2a11a8b175ccc866103.', STARTKEY => '', ENDKEY => '2'} 2023-07-12 08:15:27,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689149727218.0800d3c00f8ae8f2e555ea4c06358216. service=AccessControlService 2023-07-12 08:15:27,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689149727218.85bd114d04bba2a11a8b175ccc866103. service=AccessControlService 2023-07-12 08:15:27,684 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 08:15:27,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 0800d3c00f8ae8f2e555ea4c06358216 2023-07-12 08:15:27,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689149727218.0800d3c00f8ae8f2e555ea4c06358216.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:15:27,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0800d3c00f8ae8f2e555ea4c06358216 2023-07-12 08:15:27,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0800d3c00f8ae8f2e555ea4c06358216 2023-07-12 08:15:27,684 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 08:15:27,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 85bd114d04bba2a11a8b175ccc866103 2023-07-12 08:15:27,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689149727218.85bd114d04bba2a11a8b175ccc866103.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:15:27,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 85bd114d04bba2a11a8b175ccc866103 2023-07-12 08:15:27,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 85bd114d04bba2a11a8b175ccc866103 2023-07-12 08:15:27,687 INFO [StoreOpener-85bd114d04bba2a11a8b175ccc866103-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 85bd114d04bba2a11a8b175ccc866103 2023-07-12 08:15:27,687 INFO [StoreOpener-0800d3c00f8ae8f2e555ea4c06358216-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0800d3c00f8ae8f2e555ea4c06358216 2023-07-12 08:15:27,690 DEBUG [StoreOpener-85bd114d04bba2a11a8b175ccc866103-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85bd114d04bba2a11a8b175ccc866103/cf 2023-07-12 08:15:27,690 DEBUG [StoreOpener-0800d3c00f8ae8f2e555ea4c06358216-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0800d3c00f8ae8f2e555ea4c06358216/cf 2023-07-12 08:15:27,690 DEBUG [StoreOpener-85bd114d04bba2a11a8b175ccc866103-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85bd114d04bba2a11a8b175ccc866103/cf 2023-07-12 08:15:27,690 DEBUG [StoreOpener-0800d3c00f8ae8f2e555ea4c06358216-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0800d3c00f8ae8f2e555ea4c06358216/cf 2023-07-12 08:15:27,690 INFO [StoreOpener-0800d3c00f8ae8f2e555ea4c06358216-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0800d3c00f8ae8f2e555ea4c06358216 columnFamilyName cf 2023-07-12 08:15:27,691 INFO [StoreOpener-85bd114d04bba2a11a8b175ccc866103-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 85bd114d04bba2a11a8b175ccc866103 columnFamilyName cf 2023-07-12 08:15:27,691 INFO [StoreOpener-0800d3c00f8ae8f2e555ea4c06358216-1] regionserver.HStore(310): Store=0800d3c00f8ae8f2e555ea4c06358216/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 08:15:27,691 INFO [StoreOpener-85bd114d04bba2a11a8b175ccc866103-1] regionserver.HStore(310): Store=85bd114d04bba2a11a8b175ccc866103/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 08:15:27,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0800d3c00f8ae8f2e555ea4c06358216 2023-07-12 08:15:27,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85bd114d04bba2a11a8b175ccc866103 2023-07-12 08:15:27,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0800d3c00f8ae8f2e555ea4c06358216 2023-07-12 08:15:27,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85bd114d04bba2a11a8b175ccc866103 2023-07-12 08:15:27,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 85bd114d04bba2a11a8b175ccc866103 2023-07-12 08:15:27,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0800d3c00f8ae8f2e555ea4c06358216 2023-07-12 08:15:27,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0800d3c00f8ae8f2e555ea4c06358216/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 08:15:27,699 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0800d3c00f8ae8f2e555ea4c06358216; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63594248, jitterRate=-0.052371859550476074}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 08:15:27,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0800d3c00f8ae8f2e555ea4c06358216: 2023-07-12 08:15:27,701 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689149727218.0800d3c00f8ae8f2e555ea4c06358216., pid=69, masterSystemTime=1689149727678 2023-07-12 08:15:27,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689149727218.0800d3c00f8ae8f2e555ea4c06358216. 2023-07-12 08:15:27,703 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689149727218.0800d3c00f8ae8f2e555ea4c06358216. 2023-07-12 08:15:27,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85bd114d04bba2a11a8b175ccc866103/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 08:15:27,705 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=0800d3c00f8ae8f2e555ea4c06358216, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:27,705 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 85bd114d04bba2a11a8b175ccc866103; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60935474, jitterRate=-0.09199067950248718}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 08:15:27,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 85bd114d04bba2a11a8b175ccc866103: 2023-07-12 08:15:27,705 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689149727218.0800d3c00f8ae8f2e555ea4c06358216.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689149727705"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689149727705"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689149727705"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689149727705"}]},"ts":"1689149727705"} 2023-07-12 08:15:27,706 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689149727218.85bd114d04bba2a11a8b175ccc866103., pid=70, masterSystemTime=1689149727679 2023-07-12 08:15:27,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689149727218.85bd114d04bba2a11a8b175ccc866103. 2023-07-12 08:15:27,708 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689149727218.85bd114d04bba2a11a8b175ccc866103. 2023-07-12 08:15:27,709 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=85bd114d04bba2a11a8b175ccc866103, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:27,709 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689149727218.85bd114d04bba2a11a8b175ccc866103.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689149727709"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689149727709"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689149727709"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689149727709"}]},"ts":"1689149727709"} 2023-07-12 08:15:27,712 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=68 2023-07-12 08:15:27,712 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 0800d3c00f8ae8f2e555ea4c06358216, server=jenkins-hbase4.apache.org,43719,1689149646718 in 182 msec 2023-07-12 08:15:27,716 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0800d3c00f8ae8f2e555ea4c06358216, ASSIGN in 347 msec 2023-07-12 08:15:27,717 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=67 2023-07-12 08:15:27,717 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure 85bd114d04bba2a11a8b175ccc866103, server=jenkins-hbase4.apache.org,46655,1689149646904 in 186 msec 2023-07-12 08:15:27,721 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-12 08:15:27,721 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=85bd114d04bba2a11a8b175ccc866103, ASSIGN in 352 msec 2023-07-12 08:15:27,722 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 08:15:27,722 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149727722"}]},"ts":"1689149727722"} 2023-07-12 08:15:27,724 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-12 08:15:27,731 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 08:15:27,731 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-12 08:15:27,734 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46655] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-12 08:15:27,736 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:15:27,736 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:15:27,736 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:15:27,736 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:15:27,739 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 08:15:27,739 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-12 08:15:27,739 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 08:15:27,739 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 08:15:27,739 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-12 08:15:27,739 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 08:15:27,740 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-12 08:15:27,740 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-12 08:15:27,741 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 520 msec 2023-07-12 08:15:27,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-12 08:15:27,832 INFO [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-12 08:15:27,886 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 85bd114d04bba2a11a8b175ccc866103, 0800d3c00f8ae8f2e555ea4c06358216 2023-07-12 08:15:27,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[85bd114d04bba2a11a8b175ccc866103, 0800d3c00f8ae8f2e555ea4c06358216], force=true 2023-07-12 08:15:27,900 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[85bd114d04bba2a11a8b175ccc866103, 0800d3c00f8ae8f2e555ea4c06358216], force=true 2023-07-12 08:15:27,900 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[85bd114d04bba2a11a8b175ccc866103, 0800d3c00f8ae8f2e555ea4c06358216], force=true 2023-07-12 08:15:27,900 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[85bd114d04bba2a11a8b175ccc866103, 0800d3c00f8ae8f2e555ea4c06358216], force=true 2023-07-12 08:15:27,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 08:15:27,931 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=85bd114d04bba2a11a8b175ccc866103, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0800d3c00f8ae8f2e555ea4c06358216, UNASSIGN}] 2023-07-12 08:15:27,933 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=85bd114d04bba2a11a8b175ccc866103, UNASSIGN 2023-07-12 08:15:27,935 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=85bd114d04bba2a11a8b175ccc866103, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:27,935 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689149727218.85bd114d04bba2a11a8b175ccc866103.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689149727935"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149727935"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149727935"}]},"ts":"1689149727935"} 2023-07-12 08:15:27,937 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 85bd114d04bba2a11a8b175ccc866103, server=jenkins-hbase4.apache.org,46655,1689149646904}] 2023-07-12 08:15:27,939 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0800d3c00f8ae8f2e555ea4c06358216, UNASSIGN 2023-07-12 08:15:27,940 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=0800d3c00f8ae8f2e555ea4c06358216, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:27,941 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689149727218.0800d3c00f8ae8f2e555ea4c06358216.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689149727940"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149727940"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149727940"}]},"ts":"1689149727940"} 2023-07-12 08:15:27,947 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 0800d3c00f8ae8f2e555ea4c06358216, server=jenkins-hbase4.apache.org,43719,1689149646718}] 2023-07-12 08:15:28,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 08:15:28,090 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 85bd114d04bba2a11a8b175ccc866103 2023-07-12 08:15:28,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 85bd114d04bba2a11a8b175ccc866103, disabling compactions & flushes 2023-07-12 08:15:28,092 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689149727218.85bd114d04bba2a11a8b175ccc866103. 2023-07-12 08:15:28,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689149727218.85bd114d04bba2a11a8b175ccc866103. 2023-07-12 08:15:28,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689149727218.85bd114d04bba2a11a8b175ccc866103. after waiting 0 ms 2023-07-12 08:15:28,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689149727218.85bd114d04bba2a11a8b175ccc866103. 2023-07-12 08:15:28,092 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 85bd114d04bba2a11a8b175ccc866103 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-12 08:15:28,106 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0800d3c00f8ae8f2e555ea4c06358216 2023-07-12 08:15:28,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0800d3c00f8ae8f2e555ea4c06358216, disabling compactions & flushes 2023-07-12 08:15:28,127 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689149727218.0800d3c00f8ae8f2e555ea4c06358216. 2023-07-12 08:15:28,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689149727218.0800d3c00f8ae8f2e555ea4c06358216. 2023-07-12 08:15:28,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689149727218.0800d3c00f8ae8f2e555ea4c06358216. after waiting 0 ms 2023-07-12 08:15:28,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689149727218.0800d3c00f8ae8f2e555ea4c06358216. 2023-07-12 08:15:28,127 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 0800d3c00f8ae8f2e555ea4c06358216 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-12 08:15:28,143 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85bd114d04bba2a11a8b175ccc866103/.tmp/cf/0e8085003c314ea3a16dbf23a57e3f02 2023-07-12 08:15:28,150 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0800d3c00f8ae8f2e555ea4c06358216/.tmp/cf/f22c4c57d1544214a3140ae1d5618c77 2023-07-12 08:15:28,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0800d3c00f8ae8f2e555ea4c06358216/.tmp/cf/f22c4c57d1544214a3140ae1d5618c77 as hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0800d3c00f8ae8f2e555ea4c06358216/cf/f22c4c57d1544214a3140ae1d5618c77 2023-07-12 08:15:28,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85bd114d04bba2a11a8b175ccc866103/.tmp/cf/0e8085003c314ea3a16dbf23a57e3f02 as hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85bd114d04bba2a11a8b175ccc866103/cf/0e8085003c314ea3a16dbf23a57e3f02 2023-07-12 08:15:28,164 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0800d3c00f8ae8f2e555ea4c06358216/cf/f22c4c57d1544214a3140ae1d5618c77, entries=1, sequenceid=5, filesize=4.7 K 2023-07-12 08:15:28,164 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85bd114d04bba2a11a8b175ccc866103/cf/0e8085003c314ea3a16dbf23a57e3f02, entries=1, sequenceid=5, filesize=4.7 K 2023-07-12 08:15:28,165 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 85bd114d04bba2a11a8b175ccc866103 in 73ms, sequenceid=5, compaction requested=false 2023-07-12 08:15:28,165 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-12 08:15:28,165 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 0800d3c00f8ae8f2e555ea4c06358216 in 38ms, sequenceid=5, compaction requested=false 2023-07-12 08:15:28,165 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-12 08:15:28,202 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85bd114d04bba2a11a8b175ccc866103/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 08:15:28,202 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 08:15:28,202 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0800d3c00f8ae8f2e555ea4c06358216/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 08:15:28,203 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689149727218.85bd114d04bba2a11a8b175ccc866103. 2023-07-12 08:15:28,203 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 85bd114d04bba2a11a8b175ccc866103: 2023-07-12 08:15:28,203 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 08:15:28,203 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689149727218.0800d3c00f8ae8f2e555ea4c06358216. 2023-07-12 08:15:28,203 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0800d3c00f8ae8f2e555ea4c06358216: 2023-07-12 08:15:28,208 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 85bd114d04bba2a11a8b175ccc866103 2023-07-12 08:15:28,208 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=85bd114d04bba2a11a8b175ccc866103, regionState=CLOSED 2023-07-12 08:15:28,208 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689149727218.85bd114d04bba2a11a8b175ccc866103.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689149728208"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149728208"}]},"ts":"1689149728208"} 2023-07-12 08:15:28,209 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0800d3c00f8ae8f2e555ea4c06358216 2023-07-12 08:15:28,209 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=0800d3c00f8ae8f2e555ea4c06358216, regionState=CLOSED 2023-07-12 08:15:28,209 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689149727218.0800d3c00f8ae8f2e555ea4c06358216.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689149728209"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149728209"}]},"ts":"1689149728209"} 2023-07-12 08:15:28,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 08:15:28,216 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-12 08:15:28,216 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 85bd114d04bba2a11a8b175ccc866103, server=jenkins-hbase4.apache.org,46655,1689149646904 in 275 msec 2023-07-12 08:15:28,217 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-12 08:15:28,217 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 0800d3c00f8ae8f2e555ea4c06358216, server=jenkins-hbase4.apache.org,43719,1689149646718 in 266 msec 2023-07-12 08:15:28,218 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=85bd114d04bba2a11a8b175ccc866103, UNASSIGN in 289 msec 2023-07-12 08:15:28,219 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=71 2023-07-12 08:15:28,219 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0800d3c00f8ae8f2e555ea4c06358216, UNASSIGN in 286 msec 2023-07-12 08:15:28,301 DEBUG [PEWorker-5] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2cf939d151af96cd37440a0d0e762999/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-12 08:15:28,304 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689149727218.85bd114d04bba2a11a8b175ccc866103.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-12 08:15:28,304 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689149727218.0800d3c00f8ae8f2e555ea4c06358216.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-12 08:15:28,305 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689149727219.2cf939d151af96cd37440a0d0e762999.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-12 08:15:28,375 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2cf939d151af96cd37440a0d0e762999, ASSIGN}] 2023-07-12 08:15:28,376 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2cf939d151af96cd37440a0d0e762999, ASSIGN 2023-07-12 08:15:28,383 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2cf939d151af96cd37440a0d0e762999, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,46655,1689149646904; forceNewPlan=false, retain=false 2023-07-12 08:15:28,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 08:15:28,534 INFO [jenkins-hbase4:33919] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-12 08:15:28,536 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=2cf939d151af96cd37440a0d0e762999, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:28,536 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689149727219.2cf939d151af96cd37440a0d0e762999.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689149728536"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149728536"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149728536"}]},"ts":"1689149728536"} 2023-07-12 08:15:28,539 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 2cf939d151af96cd37440a0d0e762999, server=jenkins-hbase4.apache.org,46655,1689149646904}] 2023-07-12 08:15:28,698 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689149727219.2cf939d151af96cd37440a0d0e762999. 2023-07-12 08:15:28,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2cf939d151af96cd37440a0d0e762999, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689149727219.2cf939d151af96cd37440a0d0e762999.', STARTKEY => '', ENDKEY => ''} 2023-07-12 08:15:28,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689149727219.2cf939d151af96cd37440a0d0e762999. service=AccessControlService 2023-07-12 08:15:28,699 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 08:15:28,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 2cf939d151af96cd37440a0d0e762999 2023-07-12 08:15:28,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689149727219.2cf939d151af96cd37440a0d0e762999.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:15:28,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2cf939d151af96cd37440a0d0e762999 2023-07-12 08:15:28,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2cf939d151af96cd37440a0d0e762999 2023-07-12 08:15:28,701 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2cf939d151af96cd37440a0d0e762999/.regioninfo 2023-07-12 08:15:28,727 INFO [StoreOpener-2cf939d151af96cd37440a0d0e762999-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2cf939d151af96cd37440a0d0e762999 2023-07-12 08:15:28,728 DEBUG [StoreOpener-2cf939d151af96cd37440a0d0e762999-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2cf939d151af96cd37440a0d0e762999/cf 2023-07-12 08:15:28,729 DEBUG [StoreOpener-2cf939d151af96cd37440a0d0e762999-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2cf939d151af96cd37440a0d0e762999/cf 2023-07-12 08:15:28,729 INFO [StoreOpener-2cf939d151af96cd37440a0d0e762999-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2cf939d151af96cd37440a0d0e762999 columnFamilyName cf 2023-07-12 08:15:28,791 DEBUG [StoreOpener-2cf939d151af96cd37440a0d0e762999-1] regionserver.HStore(539): loaded hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2cf939d151af96cd37440a0d0e762999/cf/0e8085003c314ea3a16dbf23a57e3f02.85bd114d04bba2a11a8b175ccc866103->hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85bd114d04bba2a11a8b175ccc866103/cf/0e8085003c314ea3a16dbf23a57e3f02-top 2023-07-12 08:15:28,807 DEBUG [StoreOpener-2cf939d151af96cd37440a0d0e762999-1] regionserver.HStore(539): loaded hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2cf939d151af96cd37440a0d0e762999/cf/f22c4c57d1544214a3140ae1d5618c77.0800d3c00f8ae8f2e555ea4c06358216->hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0800d3c00f8ae8f2e555ea4c06358216/cf/f22c4c57d1544214a3140ae1d5618c77-top 2023-07-12 08:15:28,808 INFO [StoreOpener-2cf939d151af96cd37440a0d0e762999-1] regionserver.HStore(310): Store=2cf939d151af96cd37440a0d0e762999/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 08:15:28,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2cf939d151af96cd37440a0d0e762999 2023-07-12 08:15:28,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2cf939d151af96cd37440a0d0e762999 2023-07-12 08:15:28,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2cf939d151af96cd37440a0d0e762999 2023-07-12 08:15:28,817 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2cf939d151af96cd37440a0d0e762999; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61335883, jitterRate=-0.08602412045001984}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 08:15:28,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2cf939d151af96cd37440a0d0e762999: 2023-07-12 08:15:28,818 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689149727219.2cf939d151af96cd37440a0d0e762999., pid=77, masterSystemTime=1689149728692 2023-07-12 08:15:28,819 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689149727219.2cf939d151af96cd37440a0d0e762999.,because compaction is disabled. 2023-07-12 08:15:28,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689149727219.2cf939d151af96cd37440a0d0e762999. 2023-07-12 08:15:28,821 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689149727219.2cf939d151af96cd37440a0d0e762999. 2023-07-12 08:15:28,822 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=2cf939d151af96cd37440a0d0e762999, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:28,822 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689149727219.2cf939d151af96cd37440a0d0e762999.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689149728821"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689149728821"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689149728821"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689149728821"}]},"ts":"1689149728821"} 2023-07-12 08:15:28,834 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-12 08:15:28,834 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 2cf939d151af96cd37440a0d0e762999, server=jenkins-hbase4.apache.org,46655,1689149646904 in 292 msec 2023-07-12 08:15:28,840 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-12 08:15:28,840 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2cf939d151af96cd37440a0d0e762999, ASSIGN in 459 msec 2023-07-12 08:15:28,844 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[85bd114d04bba2a11a8b175ccc866103, 0800d3c00f8ae8f2e555ea4c06358216], force=true in 949 msec 2023-07-12 08:15:29,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 08:15:29,014 INFO [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-12 08:15:29,015 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-12 08:15:29,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689149729015 (current time:1689149729015). 2023-07-12 08:15:29,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 08:15:29,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] zookeeper.ReadOnlyZKClient(139): Connect 0x551461a4 to 127.0.0.1:54842 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:15:29,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@38c5116, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:15:29,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:15:29,036 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59210, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:15:29,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x551461a4 to 127.0.0.1:54842 2023-07-12 08:15:29,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:15:29,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] zookeeper.ReadOnlyZKClient(139): Connect 0x62923d19 to 127.0.0.1:54842 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:15:29,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@147d79ae, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:15:29,050 DEBUG [hconnection-0x75189ed6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:15:29,055 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59226, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:15:29,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:15:29,066 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37440, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:15:29,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x62923d19 to 127.0.0.1:54842 2023-07-12 08:15:29,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:15:29,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-12 08:15:29,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 08:15:29,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-12 08:15:29,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-12 08:15:29,082 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-12 08:15:29,087 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689150329087 2023-07-12 08:15:29,087 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-12 08:15:29,092 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 08:15:29,093 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 08:15:29,096 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-12 08:15:29,100 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-12 08:15:29,106 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 26 msec 2023-07-12 08:15:29,108 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-12 08:15:29,109 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689150329109 2023-07-12 08:15:29,134 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,134 INFO [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-12 08:15:29,134 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:15:29,136 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-12 08:15:29,136 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-12 08:15:29,137 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,137 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,138 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:29,138 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:29,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:29,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:29,138 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:29,138 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:29,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:29,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:29,139 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:29,139 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 08:15:29,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:29,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:29,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,141 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,141 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,141 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-12 08:15:29,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-12 08:15:29,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-12 08:15:29,142 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-12 08:15:29,142 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-12 08:15:29,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,142 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-12 08:15:29,142 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,142 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-12 08:15:29,143 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:15:29,142 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,143 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-12 08:15:29,143 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:15:29,147 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,147 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-12 08:15:29,147 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:15:29,147 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-12 08:15:29,147 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-12 08:15:29,147 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43719,1689149646718' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-12 08:15:29,147 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-12 08:15:29,147 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-12 08:15:29,147 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46655,1689149646904' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-12 08:15:29,150 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-12 08:15:29,150 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-12 08:15:29,150 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43131,1689149646833' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-12 08:15:29,151 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,151 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,151 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:29,152 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:29,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:15:29,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:15:29,152 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:15:29,152 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,152 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:15:29,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:15:29,154 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:15:29,154 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,154 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:15:29,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:29,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:29,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:29,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:15:29,156 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46655,1689149646904' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-12 08:15:29,156 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79f7b5e[Count = 0] remaining members to acquire global barrier 2023-07-12 08:15:29,156 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-12 08:15:29,156 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,157 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,157 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,157 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,157 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,158 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-12 08:15:29,158 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-12 08:15:29,158 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,43719,1689149646718' in zk 2023-07-12 08:15:29,157 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,158 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:29,158 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 08:15:29,158 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-12 08:15:29,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,158 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-12 08:15:29,158 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-12 08:15:29,158 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,43131,1689149646833' in zk 2023-07-12 08:15:29,159 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 08:15:29,159 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 08:15:29,159 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689149727219.2cf939d151af96cd37440a0d0e762999. 2023-07-12 08:15:29,159 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689149727219.2cf939d151af96cd37440a0d0e762999. started... 2023-07-12 08:15:29,160 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2cf939d151af96cd37440a0d0e762999: 2023-07-12 08:15:29,161 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-12 08:15:29,161 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689149727219.2cf939d151af96cd37440a0d0e762999.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,161 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:15:29,161 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 08:15:29,161 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-12 08:15:29,161 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2cf939d151af96cd37440a0d0e762999/cf/0e8085003c314ea3a16dbf23a57e3f02.85bd114d04bba2a11a8b175ccc866103->hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85bd114d04bba2a11a8b175ccc866103/cf/0e8085003c314ea3a16dbf23a57e3f02-top, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2cf939d151af96cd37440a0d0e762999/cf/f22c4c57d1544214a3140ae1d5618c77.0800d3c00f8ae8f2e555ea4c06358216->hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0800d3c00f8ae8f2e555ea4c06358216/cf/f22c4c57d1544214a3140ae1d5618c77-top] hfiles 2023-07-12 08:15:29,161 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2cf939d151af96cd37440a0d0e762999/cf/0e8085003c314ea3a16dbf23a57e3f02.85bd114d04bba2a11a8b175ccc866103 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,161 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-12 08:15:29,161 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:15:29,161 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-12 08:15:29,167 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2cf939d151af96cd37440a0d0e762999/cf/f22c4c57d1544214a3140ae1d5618c77.0800d3c00f8ae8f2e555ea4c06358216 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,177 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689149727219.2cf939d151af96cd37440a0d0e762999. completed. 2023-07-12 08:15:29,178 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689149727219.2cf939d151af96cd37440a0d0e762999. 2023-07-12 08:15:29,178 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 08:15:29,178 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 08:15:29,178 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:29,178 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-12 08:15:29,178 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,46655,1689149646904' in zk 2023-07-12 08:15:29,188 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:29,188 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-12 08:15:29,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:29,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:15:29,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:15:29,189 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:15:29,189 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-12 08:15:29,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:15:29,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:15:29,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:29,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:29,193 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:15:29,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:29,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-12 08:15:29,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-12 08:15:29,194 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 08:15:29,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:15:29,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:29,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:29,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:29,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,46655,1689149646904': 2023-07-12 08:15:29,201 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46655,1689149646904' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-12 08:15:29,201 INFO [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-12 08:15:29,201 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 08:15:29,201 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 08:15:29,201 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,201 INFO [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 08:15:29,203 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,203 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,203 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:15:29,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:15:29,203 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:29,203 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,203 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:29,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,203 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:29,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:29,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:29,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:29,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:15:29,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:29,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:29,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:29,206 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:29,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,207 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:29,208 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:29,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:15:29,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:29,211 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:29,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:29,212 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:29,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:29,213 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:29,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:15:29,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:29,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:29,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:29,216 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:29,216 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,216 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:29,216 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:29,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:29,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:29,216 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:29,216 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:29,216 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:29,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:29,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:29,217 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,217 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 because node does not exist (not an error) 2023-07-12 08:15:29,216 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:29,217 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:29,216 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:15:29,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:29,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:29,216 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:29,216 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:29,217 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,217 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:29,217 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,217 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:29,217 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:29,217 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,217 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:29,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:29,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:29,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:29,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:29,219 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,259 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,311 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656036_0004_000001 (auth:SIMPLE) 2023-07-12 08:15:29,318 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-12 08:15:29,318 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,318 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,319 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689149729087Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689149729217 (+130 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689149729217Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689149729229 (+12 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689149729251 (+22 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689149729318 (+67 ms) 2023-07-12 08:15:29,322 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-12 08:15:29,325 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 230 msec 2023-07-12 08:15:29,394 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:15:29,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-12 08:15:29,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 08:15:29,396 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/export-test/export-1689149729396 2023-07-12 08:15:29,397 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34597, tgtDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/export-test/export-1689149729396, rawTgtDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/export-test/export-1689149729396, srcFsUri=hdfs://localhost:34597, srcDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4 2023-07-12 08:15:29,425 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34597, inputRoot=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4 2023-07-12 08:15:29,425 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1043956401_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/export-test/export-1689149729396, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/export-test/export-1689149729396/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,425 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34597, inputRoot=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4, snapshotDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-12 08:15:29,436 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/export-test/export-1689149729396/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:29,489 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:29,490 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:29,490 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:29,490 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:30,501 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/hadoop-6099273904547682737.jar 2023-07-12 08:15:30,502 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:30,502 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:30,571 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/hadoop-9172125215010417343.jar 2023-07-12 08:15:30,571 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:30,572 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:30,572 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:30,572 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:30,573 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:30,573 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:30,573 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 08:15:30,574 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 08:15:30,574 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 08:15:30,575 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 08:15:30,575 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 08:15:30,575 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 08:15:30,576 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 08:15:30,576 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 08:15:30,576 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 08:15:30,577 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 08:15:30,577 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 08:15:30,578 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 08:15:30,578 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 08:15:30,578 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 08:15:30,579 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 08:15:30,579 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 08:15:30,580 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 08:15:30,837 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 08:15:31,164 WARN [Listener at jenkins-hbase4.apache.org/39391] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 08:15:31,167 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-12 08:15:31,169 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-12 08:15:31,244 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 08:15:31,246 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 08:15:31,315 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656036_0005_000001 (auth:SIMPLE) 2023-07-12 08:15:36,934 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656036_0005_000001 (auth:SIMPLE) 2023-07-12 08:15:39,270 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656036_0005_000001 (auth:SIMPLE) 2023-07-12 08:15:45,436 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 08:15:45,442 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 08:15:45,488 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:45,488 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 08:15:45,488 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 08:15:45,489 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1077208093_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:45,489 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(367): hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-12 08:15:45,489 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(367): hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-12 08:15:45,490 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1077208093_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/export-test/export-1689149729396/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/export-test/export-1689149729396/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:45,490 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(367): hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/export-test/export-1689149729396/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-12 08:15:45,490 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(367): hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/export-test/export-1689149729396/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-12 08:15:45,500 INFO [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:45,500 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:45,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:45,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-12 08:15:45,510 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149745510"}]},"ts":"1689149745510"} 2023-07-12 08:15:45,511 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-12 08:15:45,513 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-12 08:15:45,514 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2cf939d151af96cd37440a0d0e762999, UNASSIGN}] 2023-07-12 08:15:45,516 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2cf939d151af96cd37440a0d0e762999, UNASSIGN 2023-07-12 08:15:45,517 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=2cf939d151af96cd37440a0d0e762999, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:45,517 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689149727219.2cf939d151af96cd37440a0d0e762999.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689149745517"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149745517"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149745517"}]},"ts":"1689149745517"} 2023-07-12 08:15:45,518 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 2cf939d151af96cd37440a0d0e762999, server=jenkins-hbase4.apache.org,46655,1689149646904}] 2023-07-12 08:15:45,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-12 08:15:45,671 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2cf939d151af96cd37440a0d0e762999 2023-07-12 08:15:45,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2cf939d151af96cd37440a0d0e762999, disabling compactions & flushes 2023-07-12 08:15:45,671 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689149727219.2cf939d151af96cd37440a0d0e762999. 2023-07-12 08:15:45,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689149727219.2cf939d151af96cd37440a0d0e762999. 2023-07-12 08:15:45,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689149727219.2cf939d151af96cd37440a0d0e762999. after waiting 0 ms 2023-07-12 08:15:45,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689149727219.2cf939d151af96cd37440a0d0e762999. 2023-07-12 08:15:45,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2cf939d151af96cd37440a0d0e762999/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-12 08:15:45,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 08:15:45,694 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689149727219.2cf939d151af96cd37440a0d0e762999. 2023-07-12 08:15:45,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2cf939d151af96cd37440a0d0e762999: 2023-07-12 08:15:45,696 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2cf939d151af96cd37440a0d0e762999 2023-07-12 08:15:45,696 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=2cf939d151af96cd37440a0d0e762999, regionState=CLOSED 2023-07-12 08:15:45,697 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689149727219.2cf939d151af96cd37440a0d0e762999.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689149745696"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149745696"}]},"ts":"1689149745696"} 2023-07-12 08:15:45,700 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-12 08:15:45,700 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 2cf939d151af96cd37440a0d0e762999, server=jenkins-hbase4.apache.org,46655,1689149646904 in 180 msec 2023-07-12 08:15:45,701 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-12 08:15:45,701 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2cf939d151af96cd37440a0d0e762999, UNASSIGN in 186 msec 2023-07-12 08:15:45,702 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149745702"}]},"ts":"1689149745702"} 2023-07-12 08:15:45,703 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-12 08:15:45,705 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-12 08:15:45,709 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 207 msec 2023-07-12 08:15:45,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-12 08:15:45,813 INFO [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-12 08:15:45,813 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:45,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:45,819 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:45,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:45,821 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:45,823 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46655] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:45,827 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0800d3c00f8ae8f2e555ea4c06358216 2023-07-12 08:15:45,827 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85bd114d04bba2a11a8b175ccc866103 2023-07-12 08:15:45,828 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2cf939d151af96cd37440a0d0e762999 2023-07-12 08:15:45,832 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:45,832 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:45,832 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:45,832 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:45,833 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-12 08:15:45,833 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-12 08:15:45,833 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-12 08:15:45,833 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-12 08:15:45,834 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:45,834 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:15:45,834 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:45,834 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:45,834 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:15:45,834 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:45,834 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:15:45,834 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:15:45,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-12 08:15:45,836 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 08:15:45,836 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 08:15:45,837 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 08:15:45,837 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 08:15:45,836 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2cf939d151af96cd37440a0d0e762999/cf, FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2cf939d151af96cd37440a0d0e762999/recovered.edits] 2023-07-12 08:15:45,838 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0800d3c00f8ae8f2e555ea4c06358216/cf, FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0800d3c00f8ae8f2e555ea4c06358216/recovered.edits] 2023-07-12 08:15:45,838 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85bd114d04bba2a11a8b175ccc866103/cf, FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85bd114d04bba2a11a8b175ccc866103/recovered.edits] 2023-07-12 08:15:45,847 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0800d3c00f8ae8f2e555ea4c06358216/cf/f22c4c57d1544214a3140ae1d5618c77 to hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0800d3c00f8ae8f2e555ea4c06358216/cf/f22c4c57d1544214a3140ae1d5618c77 2023-07-12 08:15:45,847 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2cf939d151af96cd37440a0d0e762999/cf/0e8085003c314ea3a16dbf23a57e3f02.85bd114d04bba2a11a8b175ccc866103 to hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2cf939d151af96cd37440a0d0e762999/cf/0e8085003c314ea3a16dbf23a57e3f02.85bd114d04bba2a11a8b175ccc866103 2023-07-12 08:15:45,847 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85bd114d04bba2a11a8b175ccc866103/cf/0e8085003c314ea3a16dbf23a57e3f02 to hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85bd114d04bba2a11a8b175ccc866103/cf/0e8085003c314ea3a16dbf23a57e3f02 2023-07-12 08:15:45,853 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0800d3c00f8ae8f2e555ea4c06358216/recovered.edits/8.seqid to hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0800d3c00f8ae8f2e555ea4c06358216/recovered.edits/8.seqid 2023-07-12 08:15:45,854 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2cf939d151af96cd37440a0d0e762999/cf/f22c4c57d1544214a3140ae1d5618c77.0800d3c00f8ae8f2e555ea4c06358216 to hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2cf939d151af96cd37440a0d0e762999/cf/f22c4c57d1544214a3140ae1d5618c77.0800d3c00f8ae8f2e555ea4c06358216 2023-07-12 08:15:45,855 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0800d3c00f8ae8f2e555ea4c06358216 2023-07-12 08:15:45,856 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85bd114d04bba2a11a8b175ccc866103/recovered.edits/8.seqid to hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85bd114d04bba2a11a8b175ccc866103/recovered.edits/8.seqid 2023-07-12 08:15:45,857 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85bd114d04bba2a11a8b175ccc866103 2023-07-12 08:15:45,858 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2cf939d151af96cd37440a0d0e762999/recovered.edits/12.seqid to hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2cf939d151af96cd37440a0d0e762999/recovered.edits/12.seqid 2023-07-12 08:15:45,859 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2cf939d151af96cd37440a0d0e762999 2023-07-12 08:15:45,859 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-12 08:15:45,861 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:45,865 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-12 08:15:45,867 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-12 08:15:45,868 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:45,868 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-12 08:15:45,869 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689149727219.2cf939d151af96cd37440a0d0e762999.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689149745868"}]},"ts":"9223372036854775807"} 2023-07-12 08:15:45,875 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-12 08:15:45,875 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 2cf939d151af96cd37440a0d0e762999, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689149727219.2cf939d151af96cd37440a0d0e762999.', STARTKEY => '', ENDKEY => ''}] 2023-07-12 08:15:45,875 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-12 08:15:45,875 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689149745875"}]},"ts":"9223372036854775807"} 2023-07-12 08:15:45,880 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-12 08:15:45,883 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:45,884 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 69 msec 2023-07-12 08:15:45,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-12 08:15:45,938 INFO [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-12 08:15:45,939 INFO [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:45,939 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:45,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:45,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-12 08:15:45,945 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149745945"}]},"ts":"1689149745945"} 2023-07-12 08:15:45,947 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-12 08:15:45,949 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-12 08:15:45,951 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9187b98ec5e47962cb2f0c29fa32a225, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=170147a1523012eba3d772ffd64021c1, UNASSIGN}] 2023-07-12 08:15:45,954 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9187b98ec5e47962cb2f0c29fa32a225, UNASSIGN 2023-07-12 08:15:45,954 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=170147a1523012eba3d772ffd64021c1, UNASSIGN 2023-07-12 08:15:45,956 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=9187b98ec5e47962cb2f0c29fa32a225, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:45,956 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=170147a1523012eba3d772ffd64021c1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:45,957 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689149725754.9187b98ec5e47962cb2f0c29fa32a225.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689149745956"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149745956"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149745956"}]},"ts":"1689149745956"} 2023-07-12 08:15:45,957 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689149725754.170147a1523012eba3d772ffd64021c1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689149745956"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149745956"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149745956"}]},"ts":"1689149745956"} 2023-07-12 08:15:45,959 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 9187b98ec5e47962cb2f0c29fa32a225, server=jenkins-hbase4.apache.org,43719,1689149646718}] 2023-07-12 08:15:45,959 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 170147a1523012eba3d772ffd64021c1, server=jenkins-hbase4.apache.org,46655,1689149646904}] 2023-07-12 08:15:46,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-12 08:15:46,111 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9187b98ec5e47962cb2f0c29fa32a225 2023-07-12 08:15:46,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9187b98ec5e47962cb2f0c29fa32a225, disabling compactions & flushes 2023-07-12 08:15:46,112 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689149725754.9187b98ec5e47962cb2f0c29fa32a225. 2023-07-12 08:15:46,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689149725754.9187b98ec5e47962cb2f0c29fa32a225. 2023-07-12 08:15:46,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689149725754.9187b98ec5e47962cb2f0c29fa32a225. after waiting 0 ms 2023-07-12 08:15:46,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689149725754.9187b98ec5e47962cb2f0c29fa32a225. 2023-07-12 08:15:46,112 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 170147a1523012eba3d772ffd64021c1 2023-07-12 08:15:46,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 170147a1523012eba3d772ffd64021c1, disabling compactions & flushes 2023-07-12 08:15:46,112 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689149725754.170147a1523012eba3d772ffd64021c1. 2023-07-12 08:15:46,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689149725754.170147a1523012eba3d772ffd64021c1. 2023-07-12 08:15:46,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689149725754.170147a1523012eba3d772ffd64021c1. after waiting 0 ms 2023-07-12 08:15:46,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689149725754.170147a1523012eba3d772ffd64021c1. 2023-07-12 08:15:46,140 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion/9187b98ec5e47962cb2f0c29fa32a225/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 08:15:46,140 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithMergeRegion/170147a1523012eba3d772ffd64021c1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 08:15:46,141 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 08:15:46,141 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 08:15:46,146 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689149725754.170147a1523012eba3d772ffd64021c1. 2023-07-12 08:15:46,146 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689149725754.9187b98ec5e47962cb2f0c29fa32a225. 2023-07-12 08:15:46,146 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 170147a1523012eba3d772ffd64021c1: 2023-07-12 08:15:46,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9187b98ec5e47962cb2f0c29fa32a225: 2023-07-12 08:15:46,151 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 170147a1523012eba3d772ffd64021c1 2023-07-12 08:15:46,153 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=170147a1523012eba3d772ffd64021c1, regionState=CLOSED 2023-07-12 08:15:46,153 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9187b98ec5e47962cb2f0c29fa32a225 2023-07-12 08:15:46,153 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689149725754.170147a1523012eba3d772ffd64021c1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689149746153"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149746153"}]},"ts":"1689149746153"} 2023-07-12 08:15:46,154 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=9187b98ec5e47962cb2f0c29fa32a225, regionState=CLOSED 2023-07-12 08:15:46,155 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689149725754.9187b98ec5e47962cb2f0c29fa32a225.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689149746154"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149746154"}]},"ts":"1689149746154"} 2023-07-12 08:15:46,164 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-12 08:15:46,164 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 9187b98ec5e47962cb2f0c29fa32a225, server=jenkins-hbase4.apache.org,43719,1689149646718 in 198 msec 2023-07-12 08:15:46,164 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-12 08:15:46,165 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 170147a1523012eba3d772ffd64021c1, server=jenkins-hbase4.apache.org,46655,1689149646904 in 197 msec 2023-07-12 08:15:46,166 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=170147a1523012eba3d772ffd64021c1, UNASSIGN in 213 msec 2023-07-12 08:15:46,167 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-12 08:15:46,167 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9187b98ec5e47962cb2f0c29fa32a225, UNASSIGN in 213 msec 2023-07-12 08:15:46,168 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149746168"}]},"ts":"1689149746168"} 2023-07-12 08:15:46,170 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-12 08:15:46,174 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-12 08:15:46,176 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 235 msec 2023-07-12 08:15:46,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-12 08:15:46,247 INFO [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-12 08:15:46,248 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:46,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:46,258 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:46,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:46,259 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:46,260 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46655] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:46,268 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9187b98ec5e47962cb2f0c29fa32a225 2023-07-12 08:15:46,268 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/170147a1523012eba3d772ffd64021c1 2023-07-12 08:15:46,273 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9187b98ec5e47962cb2f0c29fa32a225/cf, FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9187b98ec5e47962cb2f0c29fa32a225/recovered.edits] 2023-07-12 08:15:46,273 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/170147a1523012eba3d772ffd64021c1/cf, FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/170147a1523012eba3d772ffd64021c1/recovered.edits] 2023-07-12 08:15:46,287 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9187b98ec5e47962cb2f0c29fa32a225/cf/e2b8adee76724e6f84fb7a460afe54a2 to hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/9187b98ec5e47962cb2f0c29fa32a225/cf/e2b8adee76724e6f84fb7a460afe54a2 2023-07-12 08:15:46,287 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/170147a1523012eba3d772ffd64021c1/cf/4ec005d70c92434ea24c0772c579643f to hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/170147a1523012eba3d772ffd64021c1/cf/4ec005d70c92434ea24c0772c579643f 2023-07-12 08:15:46,292 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9187b98ec5e47962cb2f0c29fa32a225/recovered.edits/9.seqid to hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/9187b98ec5e47962cb2f0c29fa32a225/recovered.edits/9.seqid 2023-07-12 08:15:46,293 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9187b98ec5e47962cb2f0c29fa32a225 2023-07-12 08:15:46,293 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:46,293 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:46,293 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:46,293 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/170147a1523012eba3d772ffd64021c1/recovered.edits/9.seqid to hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/170147a1523012eba3d772ffd64021c1/recovered.edits/9.seqid 2023-07-12 08:15:46,293 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-12 08:15:46,293 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-12 08:15:46,294 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-12 08:15:46,294 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:46,294 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/170147a1523012eba3d772ffd64021c1 2023-07-12 08:15:46,294 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-12 08:15:46,297 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:46,300 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-12 08:15:46,302 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-12 08:15:46,315 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:46,315 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:46,315 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-07-12 08:15:46,315 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:15:46,315 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:15:46,315 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-12 08:15:46,315 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:15:46,315 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:46,315 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:15:46,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-12 08:15:46,323 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:46,323 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-12 08:15:46,323 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689149725754.9187b98ec5e47962cb2f0c29fa32a225.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689149746323"}]},"ts":"9223372036854775807"} 2023-07-12 08:15:46,324 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689149725754.170147a1523012eba3d772ffd64021c1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689149746323"}]},"ts":"9223372036854775807"} 2023-07-12 08:15:46,326 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 08:15:46,326 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9187b98ec5e47962cb2f0c29fa32a225, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689149725754.9187b98ec5e47962cb2f0c29fa32a225.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 170147a1523012eba3d772ffd64021c1, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689149725754.170147a1523012eba3d772ffd64021c1.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 08:15:46,326 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-12 08:15:46,327 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689149746326"}]},"ts":"9223372036854775807"} 2023-07-12 08:15:46,328 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-12 08:15:46,339 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:46,343 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 91 msec 2023-07-12 08:15:46,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-12 08:15:46,418 INFO [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-12 08:15:46,440 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-12 08:15:46,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:46,446 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-12 08:15:46,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:46,456 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-12 08:15:46,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:46,501 INFO [Listener at jenkins-hbase4.apache.org/39391] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=760 (was 747) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xb137b52-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xb137b52-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1077208093_17 at /127.0.0.1:57260 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3830 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0xb137b52-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xb137b52-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1077208093_17 at /127.0.0.1:58506 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1077208093_17 at /127.0.0.1:35274 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xb137b52-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xb137b52-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1634904994_1 at /127.0.0.1:57250 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1822682432) connection to jenkins-hbase4.apache.org/172.31.14.131:44429 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1634904994_1 at /127.0.0.1:35236 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=901 (was 895) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=633 (was 459) - SystemLoadAverage LEAK? -, ProcessCount=180 (was 180), AvailableMemoryMB=3139 (was 3402) 2023-07-12 08:15:46,501 WARN [Listener at jenkins-hbase4.apache.org/39391] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-12 08:15:46,531 INFO [Listener at jenkins-hbase4.apache.org/39391] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=760, OpenFileDescriptor=901, MaxFileDescriptor=60000, SystemLoadAverage=633, ProcessCount=180, AvailableMemoryMB=3138 2023-07-12 08:15:46,532 WARN [Listener at jenkins-hbase4.apache.org/39391] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-12 08:15:46,534 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 08:15:46,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 08:15:46,555 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 08:15:46,555 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-12 08:15:46,556 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 08:15:46,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-12 08:15:46,559 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testEmptyExportFileSystemState/06147e77b41dffb905d772eecf522ba5 2023-07-12 08:15:46,559 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testEmptyExportFileSystemState/04447a8ca9071218a383e3fda4808686 2023-07-12 08:15:46,560 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testEmptyExportFileSystemState/06147e77b41dffb905d772eecf522ba5 empty. 2023-07-12 08:15:46,560 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testEmptyExportFileSystemState/04447a8ca9071218a383e3fda4808686 empty. 2023-07-12 08:15:46,560 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testEmptyExportFileSystemState/06147e77b41dffb905d772eecf522ba5 2023-07-12 08:15:46,561 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testEmptyExportFileSystemState/04447a8ca9071218a383e3fda4808686 2023-07-12 08:15:46,561 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-12 08:15:46,606 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-12 08:15:46,607 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 04447a8ca9071218a383e3fda4808686, NAME => 'testtb-testEmptyExportFileSystemState,,1689149746534.04447a8ca9071218a383e3fda4808686.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp 2023-07-12 08:15:46,608 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 06147e77b41dffb905d772eecf522ba5, NAME => 'testtb-testEmptyExportFileSystemState,1,1689149746534.06147e77b41dffb905d772eecf522ba5.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp 2023-07-12 08:15:46,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-12 08:15:46,704 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689149746534.06147e77b41dffb905d772eecf522ba5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:15:46,704 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 06147e77b41dffb905d772eecf522ba5, disabling compactions & flushes 2023-07-12 08:15:46,706 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689149746534.06147e77b41dffb905d772eecf522ba5. 2023-07-12 08:15:46,706 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689149746534.06147e77b41dffb905d772eecf522ba5. 2023-07-12 08:15:46,706 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689149746534.06147e77b41dffb905d772eecf522ba5. after waiting 0 ms 2023-07-12 08:15:46,706 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689149746534.06147e77b41dffb905d772eecf522ba5. 2023-07-12 08:15:46,706 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689149746534.06147e77b41dffb905d772eecf522ba5. 2023-07-12 08:15:46,706 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 06147e77b41dffb905d772eecf522ba5: 2023-07-12 08:15:46,741 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689149746534.04447a8ca9071218a383e3fda4808686.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:15:46,741 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 04447a8ca9071218a383e3fda4808686, disabling compactions & flushes 2023-07-12 08:15:46,742 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689149746534.04447a8ca9071218a383e3fda4808686. 2023-07-12 08:15:46,742 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689149746534.04447a8ca9071218a383e3fda4808686. 2023-07-12 08:15:46,742 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689149746534.04447a8ca9071218a383e3fda4808686. after waiting 0 ms 2023-07-12 08:15:46,742 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689149746534.04447a8ca9071218a383e3fda4808686. 2023-07-12 08:15:46,742 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689149746534.04447a8ca9071218a383e3fda4808686. 2023-07-12 08:15:46,742 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 04447a8ca9071218a383e3fda4808686: 2023-07-12 08:15:46,746 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 08:15:46,747 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689149746534.06147e77b41dffb905d772eecf522ba5.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689149746747"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149746747"}]},"ts":"1689149746747"} 2023-07-12 08:15:46,747 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689149746534.04447a8ca9071218a383e3fda4808686.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689149746747"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149746747"}]},"ts":"1689149746747"} 2023-07-12 08:15:46,749 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 08:15:46,750 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 08:15:46,750 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149746750"}]},"ts":"1689149746750"} 2023-07-12 08:15:46,752 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-12 08:15:46,776 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 08:15:46,778 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 08:15:46,778 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 08:15:46,778 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 08:15:46,778 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 08:15:46,778 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=04447a8ca9071218a383e3fda4808686, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=06147e77b41dffb905d772eecf522ba5, ASSIGN}] 2023-07-12 08:15:46,781 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=06147e77b41dffb905d772eecf522ba5, ASSIGN 2023-07-12 08:15:46,781 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=04447a8ca9071218a383e3fda4808686, ASSIGN 2023-07-12 08:15:46,782 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=06147e77b41dffb905d772eecf522ba5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46655,1689149646904; forceNewPlan=false, retain=false 2023-07-12 08:15:46,782 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=04447a8ca9071218a383e3fda4808686, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43131,1689149646833; forceNewPlan=false, retain=false 2023-07-12 08:15:46,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-12 08:15:46,932 INFO [jenkins-hbase4:33919] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 08:15:46,935 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=06147e77b41dffb905d772eecf522ba5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:46,935 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689149746534.06147e77b41dffb905d772eecf522ba5.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689149746935"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149746935"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149746935"}]},"ts":"1689149746935"} 2023-07-12 08:15:46,936 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=04447a8ca9071218a383e3fda4808686, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:46,936 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689149746534.04447a8ca9071218a383e3fda4808686.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689149746936"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149746936"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149746936"}]},"ts":"1689149746936"} 2023-07-12 08:15:46,938 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure 06147e77b41dffb905d772eecf522ba5, server=jenkins-hbase4.apache.org,46655,1689149646904}] 2023-07-12 08:15:46,939 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 04447a8ca9071218a383e3fda4808686, server=jenkins-hbase4.apache.org,43131,1689149646833}] 2023-07-12 08:15:47,097 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689149746534.04447a8ca9071218a383e3fda4808686. 2023-07-12 08:15:47,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 04447a8ca9071218a383e3fda4808686, NAME => 'testtb-testEmptyExportFileSystemState,,1689149746534.04447a8ca9071218a383e3fda4808686.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 08:15:47,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689149746534.04447a8ca9071218a383e3fda4808686. service=AccessControlService 2023-07-12 08:15:47,098 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 08:15:47,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 04447a8ca9071218a383e3fda4808686 2023-07-12 08:15:47,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689149746534.04447a8ca9071218a383e3fda4808686.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:15:47,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 04447a8ca9071218a383e3fda4808686 2023-07-12 08:15:47,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 04447a8ca9071218a383e3fda4808686 2023-07-12 08:15:47,098 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689149746534.06147e77b41dffb905d772eecf522ba5. 2023-07-12 08:15:47,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 06147e77b41dffb905d772eecf522ba5, NAME => 'testtb-testEmptyExportFileSystemState,1,1689149746534.06147e77b41dffb905d772eecf522ba5.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 08:15:47,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689149746534.06147e77b41dffb905d772eecf522ba5. service=AccessControlService 2023-07-12 08:15:47,099 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 08:15:47,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 06147e77b41dffb905d772eecf522ba5 2023-07-12 08:15:47,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689149746534.06147e77b41dffb905d772eecf522ba5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:15:47,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 06147e77b41dffb905d772eecf522ba5 2023-07-12 08:15:47,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 06147e77b41dffb905d772eecf522ba5 2023-07-12 08:15:47,100 INFO [StoreOpener-04447a8ca9071218a383e3fda4808686-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 04447a8ca9071218a383e3fda4808686 2023-07-12 08:15:47,100 INFO [StoreOpener-06147e77b41dffb905d772eecf522ba5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 06147e77b41dffb905d772eecf522ba5 2023-07-12 08:15:47,101 DEBUG [StoreOpener-04447a8ca9071218a383e3fda4808686-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testEmptyExportFileSystemState/04447a8ca9071218a383e3fda4808686/cf 2023-07-12 08:15:47,101 DEBUG [StoreOpener-04447a8ca9071218a383e3fda4808686-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testEmptyExportFileSystemState/04447a8ca9071218a383e3fda4808686/cf 2023-07-12 08:15:47,101 DEBUG [StoreOpener-06147e77b41dffb905d772eecf522ba5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testEmptyExportFileSystemState/06147e77b41dffb905d772eecf522ba5/cf 2023-07-12 08:15:47,101 DEBUG [StoreOpener-06147e77b41dffb905d772eecf522ba5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testEmptyExportFileSystemState/06147e77b41dffb905d772eecf522ba5/cf 2023-07-12 08:15:47,102 INFO [StoreOpener-06147e77b41dffb905d772eecf522ba5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 06147e77b41dffb905d772eecf522ba5 columnFamilyName cf 2023-07-12 08:15:47,102 INFO [StoreOpener-04447a8ca9071218a383e3fda4808686-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 04447a8ca9071218a383e3fda4808686 columnFamilyName cf 2023-07-12 08:15:47,103 INFO [StoreOpener-06147e77b41dffb905d772eecf522ba5-1] regionserver.HStore(310): Store=06147e77b41dffb905d772eecf522ba5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 08:15:47,103 INFO [StoreOpener-04447a8ca9071218a383e3fda4808686-1] regionserver.HStore(310): Store=04447a8ca9071218a383e3fda4808686/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 08:15:47,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testEmptyExportFileSystemState/06147e77b41dffb905d772eecf522ba5 2023-07-12 08:15:47,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testEmptyExportFileSystemState/04447a8ca9071218a383e3fda4808686 2023-07-12 08:15:47,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testEmptyExportFileSystemState/06147e77b41dffb905d772eecf522ba5 2023-07-12 08:15:47,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testEmptyExportFileSystemState/04447a8ca9071218a383e3fda4808686 2023-07-12 08:15:47,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 06147e77b41dffb905d772eecf522ba5 2023-07-12 08:15:47,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 04447a8ca9071218a383e3fda4808686 2023-07-12 08:15:47,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testEmptyExportFileSystemState/06147e77b41dffb905d772eecf522ba5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 08:15:47,115 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 06147e77b41dffb905d772eecf522ba5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59430881, jitterRate=-0.11441086232662201}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 08:15:47,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testEmptyExportFileSystemState/04447a8ca9071218a383e3fda4808686/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 08:15:47,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 06147e77b41dffb905d772eecf522ba5: 2023-07-12 08:15:47,116 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 04447a8ca9071218a383e3fda4808686; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74704429, jitterRate=0.11318273842334747}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 08:15:47,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 04447a8ca9071218a383e3fda4808686: 2023-07-12 08:15:47,116 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689149746534.06147e77b41dffb905d772eecf522ba5., pid=93, masterSystemTime=1689149747091 2023-07-12 08:15:47,116 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689149746534.04447a8ca9071218a383e3fda4808686., pid=94, masterSystemTime=1689149747091 2023-07-12 08:15:47,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689149746534.06147e77b41dffb905d772eecf522ba5. 2023-07-12 08:15:47,118 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689149746534.06147e77b41dffb905d772eecf522ba5. 2023-07-12 08:15:47,118 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=06147e77b41dffb905d772eecf522ba5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:47,118 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689149746534.06147e77b41dffb905d772eecf522ba5.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689149747118"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689149747118"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689149747118"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689149747118"}]},"ts":"1689149747118"} 2023-07-12 08:15:47,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689149746534.04447a8ca9071218a383e3fda4808686. 2023-07-12 08:15:47,119 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=04447a8ca9071218a383e3fda4808686, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:47,119 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689149746534.04447a8ca9071218a383e3fda4808686.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689149747119"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689149747119"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689149747119"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689149747119"}]},"ts":"1689149747119"} 2023-07-12 08:15:47,119 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689149746534.04447a8ca9071218a383e3fda4808686. 2023-07-12 08:15:47,122 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=92 2023-07-12 08:15:47,122 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure 06147e77b41dffb905d772eecf522ba5, server=jenkins-hbase4.apache.org,46655,1689149646904 in 182 msec 2023-07-12 08:15:47,123 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-07-12 08:15:47,123 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 04447a8ca9071218a383e3fda4808686, server=jenkins-hbase4.apache.org,43131,1689149646833 in 182 msec 2023-07-12 08:15:47,124 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=06147e77b41dffb905d772eecf522ba5, ASSIGN in 344 msec 2023-07-12 08:15:47,125 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=90 2023-07-12 08:15:47,125 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=04447a8ca9071218a383e3fda4808686, ASSIGN in 345 msec 2023-07-12 08:15:47,126 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 08:15:47,126 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149747126"}]},"ts":"1689149747126"} 2023-07-12 08:15:47,127 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-12 08:15:47,129 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 08:15:47,129 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-12 08:15:47,130 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46655] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 08:15:47,132 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:15:47,132 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:15:47,132 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:15:47,132 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:15:47,133 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 08:15:47,134 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 08:15:47,133 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 08:15:47,134 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 08:15:47,140 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 599 msec 2023-07-12 08:15:47,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-12 08:15:47,194 INFO [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-12 08:15:47,194 DEBUG [Listener at jenkins-hbase4.apache.org/39391] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testEmptyExportFileSystemState get assigned. Timeout = 60000ms 2023-07-12 08:15:47,194 INFO [Listener at jenkins-hbase4.apache.org/39391] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 08:15:47,197 INFO [Listener at jenkins-hbase4.apache.org/39391] hbase.HBaseTestingUtility(3484): All regions for table testtb-testEmptyExportFileSystemState assigned to meta. Checking AM states. 2023-07-12 08:15:47,198 INFO [Listener at jenkins-hbase4.apache.org/39391] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 08:15:47,198 INFO [Listener at jenkins-hbase4.apache.org/39391] hbase.HBaseTestingUtility(3504): All regions for table testtb-testEmptyExportFileSystemState assigned. 2023-07-12 08:15:47,201 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 08:15:47,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689149747201 (current time:1689149747201). 2023-07-12 08:15:47,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 08:15:47,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] zookeeper.ReadOnlyZKClient(139): Connect 0x468a1739 to 127.0.0.1:54842 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:15:47,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@da61f7c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:15:47,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:15:47,232 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34790, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:15:47,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x468a1739 to 127.0.0.1:54842 2023-07-12 08:15:47,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:15:47,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] zookeeper.ReadOnlyZKClient(139): Connect 0x67ffe149 to 127.0.0.1:54842 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:15:47,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@71da1150, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:15:47,351 DEBUG [hconnection-0x4c3aade8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:15:47,354 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34804, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:15:47,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:15:47,360 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34204, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:15:47,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x67ffe149 to 127.0.0.1:54842 2023-07-12 08:15:47,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:15:47,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 08:15:47,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 08:15:47,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 08:15:47,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 08:15:47,368 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 08:15:47,371 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689150347371 2023-07-12 08:15:47,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 08:15:47,371 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-12 08:15:47,372 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 08:15:47,373 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 08:15:47,374 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 08:15:47,374 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 08:15:47,377 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 10 msec 2023-07-12 08:15:47,383 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 08:15:47,389 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689150347389 2023-07-12 08:15:47,444 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,444 INFO [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-12 08:15:47,444 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:15:47,446 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-12 08:15:47,446 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-12 08:15:47,447 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,447 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,473 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:15:47,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 08:15:47,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 08:15:47,474 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 08:15:47,476 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:47,476 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:47,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:47,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:47,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:47,476 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:47,476 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:47,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:47,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:47,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:47,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,478 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:47,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,478 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:47,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,478 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,478 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:47,478 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 08:15:47,478 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-12 08:15:47,478 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-12 08:15:47,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,479 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 08:15:47,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-12 08:15:47,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,479 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 08:15:47,480 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 08:15:47,487 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,487 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 08:15:47,487 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:15:47,500 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,500 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 08:15:47,500 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:15:47,510 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,512 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 08:15:47,512 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 08:15:47,513 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:15:47,512 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 08:15:47,513 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 08:15:47,512 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 08:15:47,517 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43131,1689149646833' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 08:15:47,517 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43719,1689149646718' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 08:15:47,514 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 08:15:47,517 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 08:15:47,518 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46655,1689149646904' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 08:15:47,520 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,520 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:47,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:47,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:15:47,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:15:47,521 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,521 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,522 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:47,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:15:47,522 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:15:47,522 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,522 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:15:47,523 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:15:47,523 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,524 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:15:47,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:47,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:47,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:47,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:15:47,526 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43131,1689149646833' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-12 08:15:47,526 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@44e1c8e8[Count = 1] remaining members to acquire global barrier 2023-07-12 08:15:47,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:47,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:15:47,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:15:47,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:15:47,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:15:47,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:47,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:47,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:47,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:15:47,529 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46655,1689149646904' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-12 08:15:47,529 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@44e1c8e8[Count = 0] remaining members to acquire global barrier 2023-07-12 08:15:47,529 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-12 08:15:47,530 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,535 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,535 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 08:15:47,536 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,536 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,536 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:47,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,536 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 08:15:47,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,536 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 08:15:47,536 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 08:15:47,536 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43719,1689149646718' in zk 2023-07-12 08:15:47,537 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:47,537 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 08:15:47,539 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 08:15:47,539 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:15:47,539 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 08:15:47,550 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 08:15:47,579 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 08:15:47,568 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689149746534.04447a8ca9071218a383e3fda4808686. 2023-07-12 08:15:47,579 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689149746534.06147e77b41dffb905d772eecf522ba5. 2023-07-12 08:15:47,579 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689149746534.04447a8ca9071218a383e3fda4808686. started... 2023-07-12 08:15:47,579 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689149746534.06147e77b41dffb905d772eecf522ba5. started... 2023-07-12 08:15:47,568 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 08:15:47,579 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 08:15:47,581 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 04447a8ca9071218a383e3fda4808686: 2023-07-12 08:15:47,583 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 06147e77b41dffb905d772eecf522ba5: 2023-07-12 08:15:47,583 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689149746534.04447a8ca9071218a383e3fda4808686.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,583 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 08:15:47,583 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 08:15:47,583 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689149746534.06147e77b41dffb905d772eecf522ba5.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,583 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 08:15:47,583 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 08:15:47,672 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689149746534.06147e77b41dffb905d772eecf522ba5. completed. 2023-07-12 08:15:47,672 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689149746534.06147e77b41dffb905d772eecf522ba5. 2023-07-12 08:15:47,672 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 08:15:47,672 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 08:15:47,672 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:47,672 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689149746534.04447a8ca9071218a383e3fda4808686. completed. 2023-07-12 08:15:47,673 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689149746534.04447a8ca9071218a383e3fda4808686. 2023-07-12 08:15:47,672 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 08:15:47,673 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 08:15:47,673 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 08:15:47,673 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46655,1689149646904' in zk 2023-07-12 08:15:47,673 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:47,673 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 08:15:47,673 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43131,1689149646833' in zk 2023-07-12 08:15:47,674 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:47,674 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 08:15:47,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:47,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:15:47,675 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:15:47,675 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:15:47,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:15:47,675 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 08:15:47,676 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 08:15:47,676 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:15:47,676 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 08:15:47,677 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:47,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:15:47,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 08:15:47,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 08:15:47,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:15:47,678 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 08:15:47,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:47,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:47,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:47,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:15:47,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:47,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:47,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:47,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,46655,1689149646904': 2023-07-12 08:15:47,682 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46655,1689149646904' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-12 08:15:47,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:47,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:15:47,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:15:47,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:15:47,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:15:47,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:47,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:47,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:47,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:15:47,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:47,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:47,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:47,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,43131,1689149646833': 2023-07-12 08:15:47,694 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43131,1689149646833' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-12 08:15:47,694 INFO [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-12 08:15:47,694 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 08:15:47,694 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 08:15:47,694 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,694 INFO [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 08:15:47,698 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,698 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:47,699 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:15:47,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:15:47,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:15:47,700 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:47,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,700 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:47,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:15:47,701 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:47,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:47,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:47,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:47,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:15:47,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,704 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:47,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:47,704 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:47,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:47,705 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:47,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:47,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:47,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:47,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,709 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,710 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,710 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:47,710 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:47,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,711 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:47,711 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:47,711 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:47,711 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,711 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState because node does not exist (not an error) 2023-07-12 08:15:47,711 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:47,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:47,711 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:47,711 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState because node does not exist (not an error) 2023-07-12 08:15:47,711 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:47,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:47,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:47,711 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:47,711 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,711 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:47,711 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:47,711 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,711 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:47,712 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:15:47,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:47,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:47,712 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,712 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,713 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:47,718 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:47,718 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:47,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:47,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:47,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:47,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:47,787 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,943 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-12 08:15:47,944 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,944 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:47,944 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689149747371Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689149747712 (+341 ms)Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689149747712Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689149747739 (+27 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689149747769 (+30 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689149747943 (+174 ms) 2023-07-12 08:15:47,948 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 08:15:47,958 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 576 msec 2023-07-12 08:15:47,979 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:15:47,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 08:15:47,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 08:15:48,000 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43131] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689149746534.04447a8ca9071218a383e3fda4808686. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 08:15:48,002 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46655] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689149746534.06147e77b41dffb905d772eecf522ba5. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 08:15:48,007 DEBUG [Listener at jenkins-hbase4.apache.org/39391] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-12 08:15:48,007 DEBUG [Listener at jenkins-hbase4.apache.org/39391] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689149746534.04447a8ca9071218a383e3fda4808686. 2023-07-12 08:15:48,009 INFO [Listener at jenkins-hbase4.apache.org/39391] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 08:15:48,025 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 08:15:48,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689149748025 (current time:1689149748025). 2023-07-12 08:15:48,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 08:15:48,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] zookeeper.ReadOnlyZKClient(139): Connect 0x150cec9b to 127.0.0.1:54842 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:15:48,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@cc0463f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:15:48,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:15:48,042 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34806, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:15:48,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x150cec9b to 127.0.0.1:54842 2023-07-12 08:15:48,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:15:48,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] zookeeper.ReadOnlyZKClient(139): Connect 0x7e143c71 to 127.0.0.1:54842 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:15:48,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@c8e6f1c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:15:48,097 DEBUG [hconnection-0x271310c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:15:48,098 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34814, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:15:48,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:15:48,105 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34210, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:15:48,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7e143c71 to 127.0.0.1:54842 2023-07-12 08:15:48,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:15:48,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 08:15:48,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 08:15:48,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 08:15:48,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 08:15:48,111 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 08:15:48,112 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689150348112 2023-07-12 08:15:48,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 08:15:48,113 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-12 08:15:48,114 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 08:15:48,114 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 08:15:48,120 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 08:15:48,121 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 08:15:48,124 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 12 msec 2023-07-12 08:15:48,125 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 08:15:48,126 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689150348126 2023-07-12 08:15:48,182 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,183 INFO [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-12 08:15:48,183 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:15:48,184 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-12 08:15:48,185 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-12 08:15:48,215 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:15:48,215 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,215 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 08:15:48,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 08:15:48,216 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 08:15:48,217 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:48,217 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:48,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:48,217 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:48,217 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:48,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:48,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:48,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:48,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:48,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:48,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,218 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:48,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,218 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:48,218 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,219 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,219 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,219 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:48,219 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 08:15:48,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-12 08:15:48,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-12 08:15:48,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,219 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 08:15:48,219 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 08:15:48,220 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-12 08:15:48,220 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 08:15:48,220 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,220 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 08:15:48,220 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 08:15:48,220 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:15:48,220 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:15:48,224 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 08:15:48,224 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 08:15:48,224 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43131,1689149646833' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 08:15:48,224 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 08:15:48,224 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 08:15:48,224 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,224 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46655,1689149646904' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 08:15:48,224 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 08:15:48,224 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:15:48,228 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 08:15:48,228 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 08:15:48,228 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43719,1689149646718' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 08:15:48,230 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:48,230 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:48,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:15:48,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:15:48,232 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,232 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:48,232 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:15:48,232 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:15:48,232 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,232 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,232 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:15:48,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:15:48,232 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,232 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:15:48,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:48,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:48,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:48,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:15:48,234 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43131,1689149646833' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-12 08:15:48,234 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b345f82[Count = 1] remaining members to acquire global barrier 2023-07-12 08:15:48,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:48,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:15:48,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:15:48,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:15:48,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:15:48,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:48,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:48,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:48,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:15:48,238 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46655,1689149646904' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-12 08:15:48,238 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b345f82[Count = 0] remaining members to acquire global barrier 2023-07-12 08:15:48,238 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-12 08:15:48,238 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,243 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,243 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,243 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,243 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 08:15:48,243 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 08:15:48,243 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 08:15:48,243 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 08:15:48,243 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43719,1689149646718' in zk 2023-07-12 08:15:48,243 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:48,244 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:48,244 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 08:15:48,244 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 08:15:48,244 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:15:48,245 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 08:15:48,246 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 08:15:48,250 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 08:15:48,247 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689149746534.06147e77b41dffb905d772eecf522ba5. 2023-07-12 08:15:48,247 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 08:15:48,250 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689149746534.06147e77b41dffb905d772eecf522ba5. started... 2023-07-12 08:15:48,250 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 08:15:48,250 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689149746534.04447a8ca9071218a383e3fda4808686. 2023-07-12 08:15:48,250 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689149746534.04447a8ca9071218a383e3fda4808686. started... 2023-07-12 08:15:48,250 INFO [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 06147e77b41dffb905d772eecf522ba5 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-07-12 08:15:48,250 INFO [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 04447a8ca9071218a383e3fda4808686 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-07-12 08:15:48,299 INFO [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.87 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testEmptyExportFileSystemState/06147e77b41dffb905d772eecf522ba5/.tmp/cf/788505d9624646debf877d0750e7e0db 2023-07-12 08:15:48,300 INFO [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=400 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testEmptyExportFileSystemState/04447a8ca9071218a383e3fda4808686/.tmp/cf/d6dc68ce3df841d9a48a1795c9a967f9 2023-07-12 08:15:48,305 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testEmptyExportFileSystemState/06147e77b41dffb905d772eecf522ba5/.tmp/cf/788505d9624646debf877d0750e7e0db as hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testEmptyExportFileSystemState/06147e77b41dffb905d772eecf522ba5/cf/788505d9624646debf877d0750e7e0db 2023-07-12 08:15:48,307 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testEmptyExportFileSystemState/04447a8ca9071218a383e3fda4808686/.tmp/cf/d6dc68ce3df841d9a48a1795c9a967f9 as hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testEmptyExportFileSystemState/04447a8ca9071218a383e3fda4808686/cf/d6dc68ce3df841d9a48a1795c9a967f9 2023-07-12 08:15:48,311 INFO [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testEmptyExportFileSystemState/06147e77b41dffb905d772eecf522ba5/cf/788505d9624646debf877d0750e7e0db, entries=44, sequenceid=6, filesize=7.8 K 2023-07-12 08:15:48,314 INFO [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 06147e77b41dffb905d772eecf522ba5 in 64ms, sequenceid=6, compaction requested=false 2023-07-12 08:15:48,314 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-12 08:15:48,315 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 06147e77b41dffb905d772eecf522ba5: 2023-07-12 08:15:48,315 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689149746534.06147e77b41dffb905d772eecf522ba5.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,315 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 08:15:48,315 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testEmptyExportFileSystemState/06147e77b41dffb905d772eecf522ba5/cf/788505d9624646debf877d0750e7e0db] hfiles 2023-07-12 08:15:48,315 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testEmptyExportFileSystemState/06147e77b41dffb905d772eecf522ba5/cf/788505d9624646debf877d0750e7e0db for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,320 INFO [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testEmptyExportFileSystemState/04447a8ca9071218a383e3fda4808686/cf/d6dc68ce3df841d9a48a1795c9a967f9, entries=6, sequenceid=6, filesize=5.2 K 2023-07-12 08:15:48,321 INFO [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for 04447a8ca9071218a383e3fda4808686 in 71ms, sequenceid=6, compaction requested=false 2023-07-12 08:15:48,329 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 04447a8ca9071218a383e3fda4808686: 2023-07-12 08:15:48,329 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689149746534.04447a8ca9071218a383e3fda4808686.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,329 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 08:15:48,330 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testEmptyExportFileSystemState/04447a8ca9071218a383e3fda4808686/cf/d6dc68ce3df841d9a48a1795c9a967f9] hfiles 2023-07-12 08:15:48,330 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testEmptyExportFileSystemState/04447a8ca9071218a383e3fda4808686/cf/d6dc68ce3df841d9a48a1795c9a967f9 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,360 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689149746534.06147e77b41dffb905d772eecf522ba5. completed. 2023-07-12 08:15:48,361 DEBUG [rs(jenkins-hbase4.apache.org,46655,1689149646904)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689149746534.06147e77b41dffb905d772eecf522ba5. 2023-07-12 08:15:48,361 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 08:15:48,361 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 08:15:48,361 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:48,361 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 08:15:48,361 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46655,1689149646904' in zk 2023-07-12 08:15:48,363 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689149746534.04447a8ca9071218a383e3fda4808686. completed. 2023-07-12 08:15:48,363 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689149746534.04447a8ca9071218a383e3fda4808686. 2023-07-12 08:15:48,363 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 08:15:48,363 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 08:15:48,363 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:48,363 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 08:15:48,363 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43131,1689149646833' in zk 2023-07-12 08:15:48,364 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 08:15:48,364 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:15:48,364 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:48,364 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 08:15:48,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:48,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:15:48,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:15:48,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:15:48,367 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:48,367 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 08:15:48,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:15:48,367 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:15:48,367 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 08:15:48,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:48,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:48,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:48,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:15:48,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:48,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:48,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:48,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,46655,1689149646904': 2023-07-12 08:15:48,371 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46655,1689149646904' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-12 08:15:48,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:48,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:15:48,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:15:48,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:15:48,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:15:48,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:48,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:48,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:48,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:15:48,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:48,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:48,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:48,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,43131,1689149646833': 2023-07-12 08:15:48,375 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43131,1689149646833' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-12 08:15:48,375 INFO [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-12 08:15:48,375 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 08:15:48,375 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 08:15:48,375 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,375 INFO [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 08:15:48,376 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,376 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:15:48,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:15:48,376 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,376 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:48,376 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,377 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:48,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:15:48,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:48,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,377 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:48,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:48,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:48,377 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:48,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:48,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:48,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:48,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,377 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:48,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:15:48,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,378 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:48,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:48,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:48,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:48,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:15:48,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,380 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:48,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:48,380 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:48,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:48,381 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:48,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:48,383 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:48,383 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:48,383 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:48,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:48,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:48,383 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:48,383 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:48,383 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:48,383 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:48,383 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:48,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:48,383 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,384 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,384 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:48,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:48,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:48,383 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:15:48,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:48,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:48,384 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:48,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:48,388 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,388 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:48,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:48,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:48,388 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:15:48,389 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,389 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:15:48,389 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:15:48,389 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,389 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,411 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,416 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:15:48,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 08:15:48,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 08:15:48,418 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 08:15:48,474 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-12 08:15:48,475 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,475 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,475 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689149748113Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689149748383 (+270 ms)Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689149748384 (+1 ms)Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689149748392 (+8 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689149748400 (+8 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689149748474 (+74 ms) 2023-07-12 08:15:48,481 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 08:15:48,484 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 367 msec 2023-07-12 08:15:48,718 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:15:48,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 08:15:48,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 08:15:48,720 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/export-test/export-1689149748720 2023-07-12 08:15:48,720 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34597, tgtDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/export-test/export-1689149748720, rawTgtDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/export-test/export-1689149748720, srcFsUri=hdfs://localhost:34597, srcDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4 2023-07-12 08:15:48,755 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34597, inputRoot=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4 2023-07-12 08:15:48,755 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1814052678_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/export-test/export-1689149748720, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/export-test/export-1689149748720/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,755 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34597, inputRoot=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4, snapshotDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-12 08:15:48,778 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/export-test/export-1689149748720/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:48,848 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:48,848 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:48,848 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:48,849 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:49,584 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656036_0005_000001 (auth:SIMPLE) 2023-07-12 08:15:50,057 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/hadoop-7533035318749789019.jar 2023-07-12 08:15:50,057 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:50,058 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:50,141 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/hadoop-3651838167834130333.jar 2023-07-12 08:15:50,142 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:50,142 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:50,143 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:50,144 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:50,144 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:50,145 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:50,145 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 08:15:50,146 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 08:15:50,146 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 08:15:50,147 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 08:15:50,147 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 08:15:50,148 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 08:15:50,149 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 08:15:50,149 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 08:15:50,150 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 08:15:50,151 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 08:15:50,151 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 08:15:50,152 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 08:15:50,153 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 08:15:50,153 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 08:15:50,154 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 08:15:50,155 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 08:15:50,155 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 08:15:50,812 WARN [Listener at jenkins-hbase4.apache.org/39391] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 08:15:50,815 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-12 08:15:50,894 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 08:15:50,894 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 08:15:51,313 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 08:15:51,594 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656036_0006_000001 (auth:SIMPLE) 2023-07-12 08:15:57,133 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656036_0006_000001 (auth:SIMPLE) 2023-07-12 08:16:00,253 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 08:16:00,255 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 08:16:00,266 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:16:00,267 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 08:16:00,267 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 08:16:00,268 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1077208093_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:16:00,270 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(367): hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-12 08:16:00,270 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(367): hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-12 08:16:00,270 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1077208093_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/export-test/export-1689149748720/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/export-test/export-1689149748720/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:16:00,272 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(367): hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/export-test/export-1689149748720/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-12 08:16:00,272 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(367): hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/export-test/export-1689149748720/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-12 08:16:00,281 INFO [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-12 08:16:00,281 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-12 08:16:00,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 08:16:00,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-12 08:16:00,286 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149760286"}]},"ts":"1689149760286"} 2023-07-12 08:16:00,288 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-12 08:16:00,290 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-12 08:16:00,291 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=04447a8ca9071218a383e3fda4808686, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=06147e77b41dffb905d772eecf522ba5, UNASSIGN}] 2023-07-12 08:16:00,292 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=06147e77b41dffb905d772eecf522ba5, UNASSIGN 2023-07-12 08:16:00,294 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=04447a8ca9071218a383e3fda4808686, UNASSIGN 2023-07-12 08:16:00,296 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=04447a8ca9071218a383e3fda4808686, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:16:00,296 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689149746534.04447a8ca9071218a383e3fda4808686.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689149760295"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149760295"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149760295"}]},"ts":"1689149760295"} 2023-07-12 08:16:00,297 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=06147e77b41dffb905d772eecf522ba5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:16:00,297 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689149746534.06147e77b41dffb905d772eecf522ba5.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689149760297"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149760297"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149760297"}]},"ts":"1689149760297"} 2023-07-12 08:16:00,298 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 04447a8ca9071218a383e3fda4808686, server=jenkins-hbase4.apache.org,43131,1689149646833}] 2023-07-12 08:16:00,299 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 06147e77b41dffb905d772eecf522ba5, server=jenkins-hbase4.apache.org,46655,1689149646904}] 2023-07-12 08:16:00,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-12 08:16:00,451 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 04447a8ca9071218a383e3fda4808686 2023-07-12 08:16:00,451 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 04447a8ca9071218a383e3fda4808686, disabling compactions & flushes 2023-07-12 08:16:00,451 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689149746534.04447a8ca9071218a383e3fda4808686. 2023-07-12 08:16:00,451 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689149746534.04447a8ca9071218a383e3fda4808686. 2023-07-12 08:16:00,452 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689149746534.04447a8ca9071218a383e3fda4808686. after waiting 1 ms 2023-07-12 08:16:00,452 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689149746534.04447a8ca9071218a383e3fda4808686. 2023-07-12 08:16:00,452 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 06147e77b41dffb905d772eecf522ba5 2023-07-12 08:16:00,452 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 06147e77b41dffb905d772eecf522ba5, disabling compactions & flushes 2023-07-12 08:16:00,452 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689149746534.06147e77b41dffb905d772eecf522ba5. 2023-07-12 08:16:00,452 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689149746534.06147e77b41dffb905d772eecf522ba5. 2023-07-12 08:16:00,452 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689149746534.06147e77b41dffb905d772eecf522ba5. after waiting 0 ms 2023-07-12 08:16:00,452 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689149746534.06147e77b41dffb905d772eecf522ba5. 2023-07-12 08:16:00,561 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testEmptyExportFileSystemState/06147e77b41dffb905d772eecf522ba5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 08:16:00,562 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 08:16:00,569 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689149746534.06147e77b41dffb905d772eecf522ba5. 2023-07-12 08:16:00,569 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 06147e77b41dffb905d772eecf522ba5: 2023-07-12 08:16:00,572 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testEmptyExportFileSystemState/04447a8ca9071218a383e3fda4808686/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 08:16:00,573 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 08:16:00,575 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689149746534.04447a8ca9071218a383e3fda4808686. 2023-07-12 08:16:00,575 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 04447a8ca9071218a383e3fda4808686: 2023-07-12 08:16:00,577 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 06147e77b41dffb905d772eecf522ba5 2023-07-12 08:16:00,578 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 04447a8ca9071218a383e3fda4808686 2023-07-12 08:16:00,578 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=06147e77b41dffb905d772eecf522ba5, regionState=CLOSED 2023-07-12 08:16:00,578 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689149746534.06147e77b41dffb905d772eecf522ba5.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689149760578"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149760578"}]},"ts":"1689149760578"} 2023-07-12 08:16:00,579 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=04447a8ca9071218a383e3fda4808686, regionState=CLOSED 2023-07-12 08:16:00,579 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689149746534.04447a8ca9071218a383e3fda4808686.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689149760579"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149760579"}]},"ts":"1689149760579"} 2023-07-12 08:16:00,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-12 08:16:00,598 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-12 08:16:00,598 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 06147e77b41dffb905d772eecf522ba5, server=jenkins-hbase4.apache.org,46655,1689149646904 in 284 msec 2023-07-12 08:16:00,599 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-12 08:16:00,599 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 04447a8ca9071218a383e3fda4808686, server=jenkins-hbase4.apache.org,43131,1689149646833 in 298 msec 2023-07-12 08:16:00,600 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=06147e77b41dffb905d772eecf522ba5, UNASSIGN in 307 msec 2023-07-12 08:16:00,601 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=99 2023-07-12 08:16:00,602 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=04447a8ca9071218a383e3fda4808686, UNASSIGN in 308 msec 2023-07-12 08:16:00,602 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149760602"}]},"ts":"1689149760602"} 2023-07-12 08:16:00,605 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-12 08:16:00,607 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-12 08:16:00,609 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 327 msec 2023-07-12 08:16:00,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-12 08:16:00,890 INFO [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-12 08:16:00,891 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-12 08:16:00,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 08:16:00,896 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 08:16:00,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-12 08:16:00,897 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 08:16:00,899 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46655] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-12 08:16:00,903 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 08:16:00,903 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 08:16:00,903 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 08:16:00,903 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 08:16:00,904 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-12 08:16:00,904 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-12 08:16:00,904 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-12 08:16:00,904 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-12 08:16:00,906 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 08:16:00,906 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 08:16:00,906 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:16:00,906 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 08:16:00,906 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 08:16:00,906 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:16:00,906 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:16:00,906 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:16:00,912 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testEmptyExportFileSystemState/06147e77b41dffb905d772eecf522ba5 2023-07-12 08:16:00,912 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testEmptyExportFileSystemState/04447a8ca9071218a383e3fda4808686 2023-07-12 08:16:00,915 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testEmptyExportFileSystemState/06147e77b41dffb905d772eecf522ba5/cf, FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testEmptyExportFileSystemState/06147e77b41dffb905d772eecf522ba5/recovered.edits] 2023-07-12 08:16:00,915 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testEmptyExportFileSystemState/04447a8ca9071218a383e3fda4808686/cf, FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testEmptyExportFileSystemState/04447a8ca9071218a383e3fda4808686/recovered.edits] 2023-07-12 08:16:00,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-12 08:16:00,921 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testEmptyExportFileSystemState/06147e77b41dffb905d772eecf522ba5/cf/788505d9624646debf877d0750e7e0db to hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/archive/data/default/testtb-testEmptyExportFileSystemState/06147e77b41dffb905d772eecf522ba5/cf/788505d9624646debf877d0750e7e0db 2023-07-12 08:16:00,921 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testEmptyExportFileSystemState/04447a8ca9071218a383e3fda4808686/cf/d6dc68ce3df841d9a48a1795c9a967f9 to hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/archive/data/default/testtb-testEmptyExportFileSystemState/04447a8ca9071218a383e3fda4808686/cf/d6dc68ce3df841d9a48a1795c9a967f9 2023-07-12 08:16:00,925 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testEmptyExportFileSystemState/06147e77b41dffb905d772eecf522ba5/recovered.edits/9.seqid to hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/archive/data/default/testtb-testEmptyExportFileSystemState/06147e77b41dffb905d772eecf522ba5/recovered.edits/9.seqid 2023-07-12 08:16:00,925 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testEmptyExportFileSystemState/04447a8ca9071218a383e3fda4808686/recovered.edits/9.seqid to hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/archive/data/default/testtb-testEmptyExportFileSystemState/04447a8ca9071218a383e3fda4808686/recovered.edits/9.seqid 2023-07-12 08:16:00,925 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testEmptyExportFileSystemState/06147e77b41dffb905d772eecf522ba5 2023-07-12 08:16:00,926 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testEmptyExportFileSystemState/04447a8ca9071218a383e3fda4808686 2023-07-12 08:16:00,926 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-12 08:16:00,928 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 08:16:00,957 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-12 08:16:00,960 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-12 08:16:00,961 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 08:16:00,961 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-12 08:16:00,962 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689149746534.04447a8ca9071218a383e3fda4808686.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689149760962"}]},"ts":"9223372036854775807"} 2023-07-12 08:16:00,962 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689149746534.06147e77b41dffb905d772eecf522ba5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689149760962"}]},"ts":"9223372036854775807"} 2023-07-12 08:16:00,964 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 08:16:00,964 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 04447a8ca9071218a383e3fda4808686, NAME => 'testtb-testEmptyExportFileSystemState,,1689149746534.04447a8ca9071218a383e3fda4808686.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 06147e77b41dffb905d772eecf522ba5, NAME => 'testtb-testEmptyExportFileSystemState,1,1689149746534.06147e77b41dffb905d772eecf522ba5.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 08:16:00,964 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-12 08:16:00,964 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689149760964"}]},"ts":"9223372036854775807"} 2023-07-12 08:16:00,968 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-12 08:16:00,970 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 08:16:00,971 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 78 msec 2023-07-12 08:16:01,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-12 08:16:01,020 INFO [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-12 08:16:01,035 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-12 08:16:01,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:16:01,043 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-12 08:16:01,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-12 08:16:01,101 INFO [Listener at jenkins-hbase4.apache.org/39391] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=762 (was 760) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4483 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1077208093_17 at /127.0.0.1:40574 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1077208093_17 at /127.0.0.1:55896 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1822682432) connection to jenkins-hbase4.apache.org/172.31.14.131:43091 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-369772326_1 at /127.0.0.1:55870 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-369772326_1 at /127.0.0.1:36370 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xb137b52-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xb137b52-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xb137b52-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xb137b52-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1822682432) connection to jenkins-hbase4.apache.org/172.31.14.131:38175 from appattempt_1689149656036_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1077208093_17 at /127.0.0.1:50046 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=905 (was 901) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=606 (was 633), ProcessCount=181 (was 180) - ProcessCount LEAK? -, AvailableMemoryMB=2483 (was 3138) 2023-07-12 08:16:01,101 WARN [Listener at jenkins-hbase4.apache.org/39391] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-12 08:16:01,133 INFO [Listener at jenkins-hbase4.apache.org/39391] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=762, OpenFileDescriptor=905, MaxFileDescriptor=60000, SystemLoadAverage=606, ProcessCount=181, AvailableMemoryMB=2476 2023-07-12 08:16:01,133 WARN [Listener at jenkins-hbase4.apache.org/39391] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-12 08:16:01,135 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 08:16:01,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:01,139 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 08:16:01,139 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-12 08:16:01,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-12 08:16:01,143 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 08:16:01,146 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/64adf4576c42b15b4ca2955349085e51 2023-07-12 08:16:01,146 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7f643482fd40d1e5a343da242bd3ba1 2023-07-12 08:16:01,147 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/64adf4576c42b15b4ca2955349085e51 empty. 2023-07-12 08:16:01,147 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7f643482fd40d1e5a343da242bd3ba1 empty. 2023-07-12 08:16:01,147 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/64adf4576c42b15b4ca2955349085e51 2023-07-12 08:16:01,148 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7f643482fd40d1e5a343da242bd3ba1 2023-07-12 08:16:01,148 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-12 08:16:01,235 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-12 08:16:01,237 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 64adf4576c42b15b4ca2955349085e51, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689149761134.64adf4576c42b15b4ca2955349085e51.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp 2023-07-12 08:16:01,237 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => e7f643482fd40d1e5a343da242bd3ba1, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689149761134.e7f643482fd40d1e5a343da242bd3ba1.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp 2023-07-12 08:16:01,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-12 08:16:01,287 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689149761134.64adf4576c42b15b4ca2955349085e51.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:16:01,287 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 64adf4576c42b15b4ca2955349085e51, disabling compactions & flushes 2023-07-12 08:16:01,287 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689149761134.64adf4576c42b15b4ca2955349085e51. 2023-07-12 08:16:01,287 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689149761134.64adf4576c42b15b4ca2955349085e51. 2023-07-12 08:16:01,287 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689149761134.64adf4576c42b15b4ca2955349085e51. after waiting 0 ms 2023-07-12 08:16:01,287 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689149761134.64adf4576c42b15b4ca2955349085e51. 2023-07-12 08:16:01,287 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689149761134.64adf4576c42b15b4ca2955349085e51. 2023-07-12 08:16:01,287 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 64adf4576c42b15b4ca2955349085e51: 2023-07-12 08:16:01,299 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689149761134.e7f643482fd40d1e5a343da242bd3ba1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:16:01,299 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing e7f643482fd40d1e5a343da242bd3ba1, disabling compactions & flushes 2023-07-12 08:16:01,299 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689149761134.e7f643482fd40d1e5a343da242bd3ba1. 2023-07-12 08:16:01,300 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689149761134.e7f643482fd40d1e5a343da242bd3ba1. 2023-07-12 08:16:01,300 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689149761134.e7f643482fd40d1e5a343da242bd3ba1. after waiting 0 ms 2023-07-12 08:16:01,300 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689149761134.e7f643482fd40d1e5a343da242bd3ba1. 2023-07-12 08:16:01,300 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689149761134.e7f643482fd40d1e5a343da242bd3ba1. 2023-07-12 08:16:01,300 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for e7f643482fd40d1e5a343da242bd3ba1: 2023-07-12 08:16:01,305 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 08:16:01,306 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689149761134.64adf4576c42b15b4ca2955349085e51.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689149761306"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149761306"}]},"ts":"1689149761306"} 2023-07-12 08:16:01,306 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689149761134.e7f643482fd40d1e5a343da242bd3ba1.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689149761306"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149761306"}]},"ts":"1689149761306"} 2023-07-12 08:16:01,308 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 08:16:01,310 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 08:16:01,310 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149761310"}]},"ts":"1689149761310"} 2023-07-12 08:16:01,312 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-12 08:16:01,322 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 08:16:01,323 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 08:16:01,323 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 08:16:01,323 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 08:16:01,323 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 08:16:01,324 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e7f643482fd40d1e5a343da242bd3ba1, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=64adf4576c42b15b4ca2955349085e51, ASSIGN}] 2023-07-12 08:16:01,328 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=64adf4576c42b15b4ca2955349085e51, ASSIGN 2023-07-12 08:16:01,328 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e7f643482fd40d1e5a343da242bd3ba1, ASSIGN 2023-07-12 08:16:01,329 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=64adf4576c42b15b4ca2955349085e51, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43131,1689149646833; forceNewPlan=false, retain=false 2023-07-12 08:16:01,329 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e7f643482fd40d1e5a343da242bd3ba1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43719,1689149646718; forceNewPlan=false, retain=false 2023-07-12 08:16:01,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-12 08:16:01,479 INFO [jenkins-hbase4:33919] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 08:16:01,483 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=e7f643482fd40d1e5a343da242bd3ba1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:16:01,483 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689149761134.e7f643482fd40d1e5a343da242bd3ba1.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689149761483"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149761483"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149761483"}]},"ts":"1689149761483"} 2023-07-12 08:16:01,483 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=64adf4576c42b15b4ca2955349085e51, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:16:01,483 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689149761134.64adf4576c42b15b4ca2955349085e51.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689149761483"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149761483"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149761483"}]},"ts":"1689149761483"} 2023-07-12 08:16:01,485 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure e7f643482fd40d1e5a343da242bd3ba1, server=jenkins-hbase4.apache.org,43719,1689149646718}] 2023-07-12 08:16:01,487 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 64adf4576c42b15b4ca2955349085e51, server=jenkins-hbase4.apache.org,43131,1689149646833}] 2023-07-12 08:16:01,647 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689149761134.64adf4576c42b15b4ca2955349085e51. 2023-07-12 08:16:01,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 64adf4576c42b15b4ca2955349085e51, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689149761134.64adf4576c42b15b4ca2955349085e51.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 08:16:01,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689149761134.64adf4576c42b15b4ca2955349085e51. service=AccessControlService 2023-07-12 08:16:01,648 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 08:16:01,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 64adf4576c42b15b4ca2955349085e51 2023-07-12 08:16:01,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689149761134.64adf4576c42b15b4ca2955349085e51.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:16:01,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 64adf4576c42b15b4ca2955349085e51 2023-07-12 08:16:01,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 64adf4576c42b15b4ca2955349085e51 2023-07-12 08:16:01,653 INFO [StoreOpener-64adf4576c42b15b4ca2955349085e51-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 64adf4576c42b15b4ca2955349085e51 2023-07-12 08:16:01,657 DEBUG [StoreOpener-64adf4576c42b15b4ca2955349085e51-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithSkipTmp/64adf4576c42b15b4ca2955349085e51/cf 2023-07-12 08:16:01,657 DEBUG [StoreOpener-64adf4576c42b15b4ca2955349085e51-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithSkipTmp/64adf4576c42b15b4ca2955349085e51/cf 2023-07-12 08:16:01,658 INFO [StoreOpener-64adf4576c42b15b4ca2955349085e51-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 64adf4576c42b15b4ca2955349085e51 columnFamilyName cf 2023-07-12 08:16:01,659 INFO [StoreOpener-64adf4576c42b15b4ca2955349085e51-1] regionserver.HStore(310): Store=64adf4576c42b15b4ca2955349085e51/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 08:16:01,660 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689149761134.e7f643482fd40d1e5a343da242bd3ba1. 2023-07-12 08:16:01,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e7f643482fd40d1e5a343da242bd3ba1, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689149761134.e7f643482fd40d1e5a343da242bd3ba1.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 08:16:01,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689149761134.e7f643482fd40d1e5a343da242bd3ba1. service=AccessControlService 2023-07-12 08:16:01,661 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 08:16:01,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp e7f643482fd40d1e5a343da242bd3ba1 2023-07-12 08:16:01,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689149761134.e7f643482fd40d1e5a343da242bd3ba1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:16:01,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e7f643482fd40d1e5a343da242bd3ba1 2023-07-12 08:16:01,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e7f643482fd40d1e5a343da242bd3ba1 2023-07-12 08:16:01,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithSkipTmp/64adf4576c42b15b4ca2955349085e51 2023-07-12 08:16:01,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithSkipTmp/64adf4576c42b15b4ca2955349085e51 2023-07-12 08:16:01,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 64adf4576c42b15b4ca2955349085e51 2023-07-12 08:16:01,683 INFO [StoreOpener-e7f643482fd40d1e5a343da242bd3ba1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e7f643482fd40d1e5a343da242bd3ba1 2023-07-12 08:16:01,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithSkipTmp/64adf4576c42b15b4ca2955349085e51/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 08:16:01,693 DEBUG [StoreOpener-e7f643482fd40d1e5a343da242bd3ba1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7f643482fd40d1e5a343da242bd3ba1/cf 2023-07-12 08:16:01,693 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 64adf4576c42b15b4ca2955349085e51; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73440100, jitterRate=0.09434276819229126}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 08:16:01,693 DEBUG [StoreOpener-e7f643482fd40d1e5a343da242bd3ba1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7f643482fd40d1e5a343da242bd3ba1/cf 2023-07-12 08:16:01,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 64adf4576c42b15b4ca2955349085e51: 2023-07-12 08:16:01,694 INFO [StoreOpener-e7f643482fd40d1e5a343da242bd3ba1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e7f643482fd40d1e5a343da242bd3ba1 columnFamilyName cf 2023-07-12 08:16:01,695 INFO [StoreOpener-e7f643482fd40d1e5a343da242bd3ba1-1] regionserver.HStore(310): Store=e7f643482fd40d1e5a343da242bd3ba1/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 08:16:01,699 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689149761134.64adf4576c42b15b4ca2955349085e51., pid=109, masterSystemTime=1689149761643 2023-07-12 08:16:01,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7f643482fd40d1e5a343da242bd3ba1 2023-07-12 08:16:01,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689149761134.64adf4576c42b15b4ca2955349085e51. 2023-07-12 08:16:01,704 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689149761134.64adf4576c42b15b4ca2955349085e51. 2023-07-12 08:16:01,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7f643482fd40d1e5a343da242bd3ba1 2023-07-12 08:16:01,707 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=64adf4576c42b15b4ca2955349085e51, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:16:01,707 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689149761134.64adf4576c42b15b4ca2955349085e51.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689149761707"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689149761707"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689149761707"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689149761707"}]},"ts":"1689149761707"} 2023-07-12 08:16:01,715 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e7f643482fd40d1e5a343da242bd3ba1 2023-07-12 08:16:01,716 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-07-12 08:16:01,716 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 64adf4576c42b15b4ca2955349085e51, server=jenkins-hbase4.apache.org,43131,1689149646833 in 226 msec 2023-07-12 08:16:01,718 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=64adf4576c42b15b4ca2955349085e51, ASSIGN in 392 msec 2023-07-12 08:16:01,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7f643482fd40d1e5a343da242bd3ba1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 08:16:01,731 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e7f643482fd40d1e5a343da242bd3ba1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62851033, jitterRate=-0.06344662606716156}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 08:16:01,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e7f643482fd40d1e5a343da242bd3ba1: 2023-07-12 08:16:01,732 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689149761134.e7f643482fd40d1e5a343da242bd3ba1., pid=108, masterSystemTime=1689149761643 2023-07-12 08:16:01,735 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=e7f643482fd40d1e5a343da242bd3ba1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:16:01,735 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689149761134.e7f643482fd40d1e5a343da242bd3ba1.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689149761734"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689149761734"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689149761734"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689149761734"}]},"ts":"1689149761734"} 2023-07-12 08:16:01,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689149761134.e7f643482fd40d1e5a343da242bd3ba1. 2023-07-12 08:16:01,735 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689149761134.e7f643482fd40d1e5a343da242bd3ba1. 2023-07-12 08:16:01,738 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=106 2023-07-12 08:16:01,739 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure e7f643482fd40d1e5a343da242bd3ba1, server=jenkins-hbase4.apache.org,43719,1689149646718 in 251 msec 2023-07-12 08:16:01,742 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-12 08:16:01,742 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e7f643482fd40d1e5a343da242bd3ba1, ASSIGN in 415 msec 2023-07-12 08:16:01,743 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 08:16:01,743 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149761743"}]},"ts":"1689149761743"} 2023-07-12 08:16:01,745 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-12 08:16:01,748 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 08:16:01,749 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-12 08:16:01,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-12 08:16:01,751 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46655] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-12 08:16:01,752 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:16:01,752 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:16:01,753 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:16:01,754 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:16:01,757 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:01,757 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:01,757 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:01,757 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-12 08:16:01,758 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-12 08:16:01,758 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-12 08:16:01,759 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-12 08:16:01,761 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 623 msec 2023-07-12 08:16:02,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-12 08:16:02,251 INFO [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-12 08:16:02,251 DEBUG [Listener at jenkins-hbase4.apache.org/39391] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithSkipTmp get assigned. Timeout = 60000ms 2023-07-12 08:16:02,251 INFO [Listener at jenkins-hbase4.apache.org/39391] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 08:16:02,255 INFO [Listener at jenkins-hbase4.apache.org/39391] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned to meta. Checking AM states. 2023-07-12 08:16:02,255 INFO [Listener at jenkins-hbase4.apache.org/39391] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 08:16:02,255 INFO [Listener at jenkins-hbase4.apache.org/39391] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned. 2023-07-12 08:16:02,261 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 08:16:02,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689149762261 (current time:1689149762261). 2023-07-12 08:16:02,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 08:16:02,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] zookeeper.ReadOnlyZKClient(139): Connect 0x4b1b0570 to 127.0.0.1:54842 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:16:02,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@275ac6ca, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:16:02,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:16:02,287 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43306, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:16:02,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4b1b0570 to 127.0.0.1:54842 2023-07-12 08:16:02,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:16:02,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] zookeeper.ReadOnlyZKClient(139): Connect 0x3f7475d9 to 127.0.0.1:54842 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:16:02,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2cd7d7c2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:16:02,399 DEBUG [hconnection-0x5d4a2804-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:16:02,411 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43320, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:16:02,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:16:02,422 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50806, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:16:02,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3f7475d9 to 127.0.0.1:54842 2023-07-12 08:16:02,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:16:02,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-12 08:16:02,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 08:16:02,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 08:16:02,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 08:16:02,433 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 08:16:02,434 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689150362434 2023-07-12 08:16:02,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 08:16:02,434 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,436 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 08:16:02,436 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 08:16:02,437 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 08:16:02,437 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 08:16:02,439 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 7 msec 2023-07-12 08:16:02,440 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 08:16:02,441 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689150362441 2023-07-12 08:16:02,463 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,463 INFO [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-12 08:16:02,464 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:16:02,465 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-12 08:16:02,465 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-12 08:16:02,469 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,469 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,472 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:16:02,472 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:16:02,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:16:02,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:16:02,473 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:16:02,473 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:16:02,473 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:16:02,473 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:16:02,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:16:02,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:16:02,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:16:02,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:16:02,474 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:16:02,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,474 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 08:16:02,474 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,474 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,474 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-12 08:16:02,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-12 08:16:02,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-12 08:16:02,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,475 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 08:16:02,475 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 08:16:02,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,475 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 08:16:02,494 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,494 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 08:16:02,494 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:16:02,495 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,495 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 08:16:02,495 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:16:02,498 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,500 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 08:16:02,500 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 08:16:02,500 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:16:02,500 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 08:16:02,502 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 08:16:02,502 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 08:16:02,500 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 08:16:02,502 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43719,1689149646718' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 08:16:02,502 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43131,1689149646833' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 08:16:02,502 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 08:16:02,502 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46655,1689149646904' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 08:16:02,509 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,510 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,510 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,510 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,510 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:16:02,510 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,510 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,510 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:16:02,510 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:16:02,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:16:02,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:16:02,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:16:02,510 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:16:02,510 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:16:02,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:16:02,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:16:02,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:16:02,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:16:02,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:16:02,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:16:02,518 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43131,1689149646833' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-12 08:16:02,518 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@41f953cc[Count = 1] remaining members to acquire global barrier 2023-07-12 08:16:02,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:16:02,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:16:02,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:16:02,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:16:02,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:16:02,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:16:02,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:16:02,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:16:02,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:16:02,533 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43719,1689149646718' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-12 08:16:02,533 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@41f953cc[Count = 0] remaining members to acquire global barrier 2023-07-12 08:16:02,533 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-12 08:16:02,533 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,535 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,535 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,535 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 08:16:02,535 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 08:16:02,535 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:16:02,535 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,46655,1689149646904' in zk 2023-07-12 08:16:02,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,536 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 08:16:02,536 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:16:02,536 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:16:02,536 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 08:16:02,536 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 08:16:02,536 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 08:16:02,536 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689149761134.64adf4576c42b15b4ca2955349085e51. 2023-07-12 08:16:02,537 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689149761134.64adf4576c42b15b4ca2955349085e51. started... 2023-07-12 08:16:02,539 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 08:16:02,539 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 08:16:02,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-12 08:16:02,539 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 08:16:02,539 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:16:02,539 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 08:16:02,540 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 64adf4576c42b15b4ca2955349085e51: 2023-07-12 08:16:02,540 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 08:16:02,540 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689149761134.64adf4576c42b15b4ca2955349085e51.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,540 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 08:16:02,540 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 08:16:02,556 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 08:16:02,556 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689149761134.e7f643482fd40d1e5a343da242bd3ba1. 2023-07-12 08:16:02,557 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 08:16:02,557 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689149761134.e7f643482fd40d1e5a343da242bd3ba1. started... 2023-07-12 08:16:02,558 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e7f643482fd40d1e5a343da242bd3ba1: 2023-07-12 08:16:02,559 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689149761134.e7f643482fd40d1e5a343da242bd3ba1.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,559 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 08:16:02,559 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 08:16:02,614 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689149761134.64adf4576c42b15b4ca2955349085e51. completed. 2023-07-12 08:16:02,614 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689149761134.64adf4576c42b15b4ca2955349085e51. 2023-07-12 08:16:02,614 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 08:16:02,614 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 08:16:02,614 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:16:02,614 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 08:16:02,614 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43131,1689149646833' in zk 2023-07-12 08:16:02,617 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:16:02,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:16:02,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:16:02,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:16:02,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:16:02,618 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689149761134.e7f643482fd40d1e5a343da242bd3ba1. completed. 2023-07-12 08:16:02,618 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689149761134.e7f643482fd40d1e5a343da242bd3ba1. 2023-07-12 08:16:02,618 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 08:16:02,618 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 08:16:02,618 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 08:16:02,619 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:16:02,619 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 08:16:02,619 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43719,1689149646718' in zk 2023-07-12 08:16:02,619 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:16:02,619 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 08:16:02,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:16:02,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,622 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:16:02,622 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 08:16:02,622 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:16:02,622 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 08:16:02,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:16:02,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:16:02,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:16:02,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:16:02,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:16:02,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:16:02,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:16:02,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,43131,1689149646833': 2023-07-12 08:16:02,627 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43131,1689149646833' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-12 08:16:02,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:16:02,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:16:02,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:16:02,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:16:02,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:16:02,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:16:02,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:16:02,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:16:02,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:16:02,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:16:02,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:16:02,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:16:02,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,43719,1689149646718': 2023-07-12 08:16:02,633 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43719,1689149646718' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-12 08:16:02,633 INFO [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-12 08:16:02,633 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 08:16:02,633 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 08:16:02,633 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,633 INFO [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 08:16:02,635 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,635 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,635 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:16:02,635 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,635 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,635 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:16:02,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,635 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:16:02,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:16:02,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:16:02,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:16:02,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:16:02,636 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:16:02,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:16:02,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:16:02,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:16:02,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:16:02,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:16:02,637 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:16:02,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,638 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:16:02,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:16:02,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:16:02,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:16:02,641 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:16:02,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:16:02,642 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:16:02,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:16:02,642 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:16:02,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:16:02,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:16:02,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:16:02,657 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:16:02,657 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:16:02,657 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:16:02,657 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:16:02,658 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:16:02,657 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,658 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:16:02,661 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:16:02,661 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:16:02,661 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,661 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:16:02,661 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,661 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:16:02,661 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:16:02,661 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,661 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:16:02,658 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:16:02,658 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:16:02,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:16:02,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:16:02,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:16:02,658 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:16:02,663 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:16:02,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:16:02,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:16:02,664 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:16:02,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:16:02,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:16:02,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:16:02,731 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,740 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:16:02,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 08:16:02,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-12 08:16:02,742 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 08:16:02,913 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-12 08:16:02,913 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,913 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:02,913 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689149762434Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689149762663 (+229 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689149762663Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689149762686 (+23 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689149762724 (+38 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689149762913 (+189 ms) 2023-07-12 08:16:02,917 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 08:16:02,918 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 482 msec 2023-07-12 08:16:03,043 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:16:03,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 08:16:03,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 08:16:03,062 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43131] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689149761134.64adf4576c42b15b4ca2955349085e51. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 08:16:03,065 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43719] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689149761134.e7f643482fd40d1e5a343da242bd3ba1. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 08:16:03,068 DEBUG [Listener at jenkins-hbase4.apache.org/39391] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,068 DEBUG [Listener at jenkins-hbase4.apache.org/39391] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689149761134.e7f643482fd40d1e5a343da242bd3ba1. 2023-07-12 08:16:03,068 INFO [Listener at jenkins-hbase4.apache.org/39391] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 08:16:03,095 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 08:16:03,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689149763095 (current time:1689149763095). 2023-07-12 08:16:03,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 08:16:03,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] zookeeper.ReadOnlyZKClient(139): Connect 0x4c314452 to 127.0.0.1:54842 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:16:03,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40b74fd8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:16:03,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:16:03,138 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43336, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:16:03,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4c314452 to 127.0.0.1:54842 2023-07-12 08:16:03,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:16:03,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] zookeeper.ReadOnlyZKClient(139): Connect 0x6fa73371 to 127.0.0.1:54842 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:16:03,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2972e903, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:16:03,162 DEBUG [hconnection-0x53c1aa7a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:16:03,170 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43352, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:16:03,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:16:03,181 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50814, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:16:03,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6fa73371 to 127.0.0.1:54842 2023-07-12 08:16:03,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:16:03,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-12 08:16:03,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 08:16:03,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 08:16:03,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 08:16:03,188 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 08:16:03,195 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689150363195 2023-07-12 08:16:03,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 08:16:03,196 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,196 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 08:16:03,202 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 08:16:03,204 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 08:16:03,208 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 08:16:03,210 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 24 msec 2023-07-12 08:16:03,212 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 08:16:03,213 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689150363213 2023-07-12 08:16:03,264 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,264 INFO [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-12 08:16:03,264 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:16:03,267 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-12 08:16:03,267 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-12 08:16:03,267 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,267 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,269 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:16:03,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:16:03,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:16:03,270 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:16:03,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:16:03,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:16:03,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,271 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:16:03,272 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:16:03,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:16:03,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:16:03,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,273 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,273 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-12 08:16:03,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,273 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 08:16:03,274 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,274 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 08:16:03,274 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:16:03,294 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 08:16:03,295 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 08:16:03,295 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46655,1689149646904' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 08:16:03,295 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:16:03,295 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:16:03,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-12 08:16:03,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,296 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:16:03,296 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 08:16:03,296 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 08:16:03,298 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,298 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 08:16:03,298 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:16:03,300 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 08:16:03,300 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 08:16:03,300 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43719,1689149646718' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 08:16:03,300 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,300 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,301 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,301 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:16:03,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-12 08:16:03,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,301 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 08:16:03,302 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,302 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:16:03,302 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:16:03,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:16:03,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:16:03,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:16:03,303 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,303 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:16:03,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:16:03,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 08:16:03,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-12 08:16:03,304 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 08:16:03,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:16:03,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:16:03,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:16:03,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:16:03,310 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,311 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 08:16:03,311 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:16:03,312 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 08:16:03,313 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43719,1689149646718' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-12 08:16:03,313 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3d408526[Count = 1] remaining members to acquire global barrier 2023-07-12 08:16:03,313 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 08:16:03,313 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43131,1689149646833' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 08:16:03,315 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:16:03,315 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:16:03,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:16:03,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:16:03,315 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:16:03,315 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:16:03,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:16:03,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:16:03,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:16:03,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:16:03,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:16:03,319 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43131,1689149646833' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-12 08:16:03,319 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3d408526[Count = 0] remaining members to acquire global barrier 2023-07-12 08:16:03,319 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-12 08:16:03,319 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,330 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,330 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,330 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,331 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 08:16:03,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,331 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:16:03,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,331 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 08:16:03,331 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 08:16:03,331 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 08:16:03,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,331 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689149761134.e7f643482fd40d1e5a343da242bd3ba1. 2023-07-12 08:16:03,331 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:16:03,331 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 08:16:03,331 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 08:16:03,331 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 08:16:03,331 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,46655,1689149646904' in zk 2023-07-12 08:16:03,332 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689149761134.e7f643482fd40d1e5a343da242bd3ba1. started... 2023-07-12 08:16:03,332 INFO [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e7f643482fd40d1e5a343da242bd3ba1 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-12 08:16:03,333 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 08:16:03,333 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:16:03,333 DEBUG [member: 'jenkins-hbase4.apache.org,46655,1689149646904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 08:16:03,354 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 08:16:03,356 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 08:16:03,356 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689149761134.64adf4576c42b15b4ca2955349085e51. 2023-07-12 08:16:03,357 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689149761134.64adf4576c42b15b4ca2955349085e51. started... 2023-07-12 08:16:03,357 INFO [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 64adf4576c42b15b4ca2955349085e51 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-12 08:16:03,489 INFO [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7f643482fd40d1e5a343da242bd3ba1/.tmp/cf/27a579a2932c474eb1f66c826cc1d167 2023-07-12 08:16:03,493 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-12 08:16:03,502 INFO [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithSkipTmp/64adf4576c42b15b4ca2955349085e51/.tmp/cf/ee660bbb2aa1497da82b33ff0d3d8a5f 2023-07-12 08:16:03,504 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7f643482fd40d1e5a343da242bd3ba1/.tmp/cf/27a579a2932c474eb1f66c826cc1d167 as hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7f643482fd40d1e5a343da242bd3ba1/cf/27a579a2932c474eb1f66c826cc1d167 2023-07-12 08:16:03,504 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:16:03,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 08:16:03,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-12 08:16:03,506 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 08:16:03,512 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithSkipTmp/64adf4576c42b15b4ca2955349085e51/.tmp/cf/ee660bbb2aa1497da82b33ff0d3d8a5f as hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithSkipTmp/64adf4576c42b15b4ca2955349085e51/cf/ee660bbb2aa1497da82b33ff0d3d8a5f 2023-07-12 08:16:03,514 INFO [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7f643482fd40d1e5a343da242bd3ba1/cf/27a579a2932c474eb1f66c826cc1d167, entries=2, sequenceid=6, filesize=5.0 K 2023-07-12 08:16:03,517 INFO [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for e7f643482fd40d1e5a343da242bd3ba1 in 185ms, sequenceid=6, compaction requested=false 2023-07-12 08:16:03,521 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e7f643482fd40d1e5a343da242bd3ba1: 2023-07-12 08:16:03,521 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689149761134.e7f643482fd40d1e5a343da242bd3ba1.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,522 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 08:16:03,522 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7f643482fd40d1e5a343da242bd3ba1/cf/27a579a2932c474eb1f66c826cc1d167] hfiles 2023-07-12 08:16:03,522 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7f643482fd40d1e5a343da242bd3ba1/cf/27a579a2932c474eb1f66c826cc1d167 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,532 INFO [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithSkipTmp/64adf4576c42b15b4ca2955349085e51/cf/ee660bbb2aa1497da82b33ff0d3d8a5f, entries=48, sequenceid=6, filesize=8.1 K 2023-07-12 08:16:03,535 INFO [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 64adf4576c42b15b4ca2955349085e51 in 178ms, sequenceid=6, compaction requested=false 2023-07-12 08:16:03,535 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 64adf4576c42b15b4ca2955349085e51: 2023-07-12 08:16:03,535 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689149761134.64adf4576c42b15b4ca2955349085e51.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,535 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 08:16:03,536 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithSkipTmp/64adf4576c42b15b4ca2955349085e51/cf/ee660bbb2aa1497da82b33ff0d3d8a5f] hfiles 2023-07-12 08:16:03,536 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithSkipTmp/64adf4576c42b15b4ca2955349085e51/cf/ee660bbb2aa1497da82b33ff0d3d8a5f for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,667 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689149761134.e7f643482fd40d1e5a343da242bd3ba1. completed. 2023-07-12 08:16:03,667 DEBUG [rs(jenkins-hbase4.apache.org,43719,1689149646718)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689149761134.e7f643482fd40d1e5a343da242bd3ba1. 2023-07-12 08:16:03,667 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 08:16:03,668 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 08:16:03,668 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:16:03,668 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 08:16:03,668 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43719,1689149646718' in zk 2023-07-12 08:16:03,670 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689149761134.64adf4576c42b15b4ca2955349085e51. completed. 2023-07-12 08:16:03,670 DEBUG [rs(jenkins-hbase4.apache.org,43131,1689149646833)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689149761134.64adf4576c42b15b4ca2955349085e51. 2023-07-12 08:16:03,670 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:16:03,670 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 08:16:03,670 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 08:16:03,670 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:16:03,670 DEBUG [member: 'jenkins-hbase4.apache.org,43719,1689149646718' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 08:16:03,670 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 08:16:03,672 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:16:03,672 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 08:16:03,672 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43131,1689149646833' in zk 2023-07-12 08:16:03,674 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:16:03,674 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 08:16:03,674 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:16:03,674 DEBUG [member: 'jenkins-hbase4.apache.org,43131,1689149646833' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 08:16:03,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:16:03,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:16:03,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:16:03,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:16:03,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:16:03,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:16:03,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:16:03,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:16:03,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:16:03,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:16:03,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:16:03,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:16:03,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,43719,1689149646718': 2023-07-12 08:16:03,680 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43719,1689149646718' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-12 08:16:03,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:16:03,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:16:03,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:16:03,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:16:03,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:16:03,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:16:03,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:16:03,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:16:03,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:16:03,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:16:03,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:16:03,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:16:03,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,43131,1689149646833': 2023-07-12 08:16:03,685 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43131,1689149646833' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-12 08:16:03,685 INFO [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-12 08:16:03,685 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 08:16:03,685 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 08:16:03,685 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,685 INFO [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 08:16:03,687 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,687 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:16:03,687 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,687 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:16:03,688 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,688 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:16:03,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:16:03,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:16:03,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:16:03,688 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:16:03,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:16:03,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:16:03,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:16:03,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:16:03,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:16:03,689 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:16:03,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,690 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:16:03,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,690 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:16:03,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:16:03,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:16:03,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:16:03,695 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:16:03,695 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:16:03,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:16:03,695 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:16:03,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:16:03,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,700 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:16:03,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:16:03,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:16:03,700 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:16:03,700 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:16:03,700 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:16:03,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:16:03,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:16:03,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:16:03,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:16:03,702 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:16:03,702 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,702 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:16:03,702 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:16:03,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:16:03,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:16:03,703 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:16:03,703 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:16:03,703 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:16:03,703 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:16:03,703 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,703 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:16:03,703 DEBUG [(jenkins-hbase4.apache.org,33919,1689149645203)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:16:03,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:16:03,703 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,703 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,703 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:16:03,704 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,704 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:16:03,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:16:03,706 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,707 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp because node does not exist (not an error) 2023-07-12 08:16:03,791 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,806 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:16:03,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 08:16:03,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-12 08:16:03,808 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-12 08:16:03,879 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-12 08:16:03,879 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,880 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:03,880 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689149763196Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689149763703 (+507 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689149763704 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689149763722 (+18 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689149763770 (+48 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689149763879 (+109 ms) 2023-07-12 08:16:03,883 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 08:16:03,885 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 686 msec 2023-07-12 08:16:04,308 DEBUG [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:16:04,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 08:16:04,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 08:16:04,310 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/export-test/export-1689149764310 2023-07-12 08:16:04,310 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34597, tgtDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/export-test/export-1689149764310, rawTgtDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/export-test/export-1689149764310, srcFsUri=hdfs://localhost:34597, srcDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4 2023-07-12 08:16:04,344 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34597, inputRoot=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4 2023-07-12 08:16:04,345 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1748613298_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/export-test/export-1689149764310, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/export-test/export-1689149764310/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:04,345 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34597, inputRoot=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4, snapshotDir=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-12 08:16:04,355 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/export-test/export-1689149764310/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:04,572 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656036_0006_000001 (auth:SIMPLE) 2023-07-12 08:16:04,788 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 08:16:04,788 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 08:16:04,788 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 08:16:04,789 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 08:16:05,737 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/hadoop-8663748283116869099.jar 2023-07-12 08:16:05,737 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 08:16:05,737 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 08:16:05,808 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/hadoop-8996625424940317266.jar 2023-07-12 08:16:05,809 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 08:16:05,809 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 08:16:05,810 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 08:16:05,810 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 08:16:05,811 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 08:16:05,811 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 08:16:05,811 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 08:16:05,812 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 08:16:05,812 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 08:16:05,813 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 08:16:05,813 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 08:16:05,814 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 08:16:05,814 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 08:16:05,814 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 08:16:05,814 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 08:16:05,815 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 08:16:05,816 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 08:16:05,816 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 08:16:05,817 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 08:16:05,817 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 08:16:05,817 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 08:16:05,818 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 08:16:05,819 DEBUG [Listener at jenkins-hbase4.apache.org/39391] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 08:16:06,159 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 08:16:06,393 WARN [Listener at jenkins-hbase4.apache.org/39391] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 08:16:06,396 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-12 08:16:06,397 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-12 08:16:06,448 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 08:16:06,448 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 08:16:06,575 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656036_0007_000001 (auth:SIMPLE) 2023-07-12 08:16:11,756 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656036_0007_000001 (auth:SIMPLE) 2023-07-12 08:16:14,106 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656036_0007_000001 (auth:SIMPLE) 2023-07-12 08:16:17,627 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656036_0007_000001 (auth:SIMPLE) 2023-07-12 08:16:19,592 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 08:16:19,592 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 08:16:19,614 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:19,615 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 08:16:19,615 INFO [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 08:16:19,616 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1077208093_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:19,616 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(367): hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-12 08:16:19,616 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(367): hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-12 08:16:19,616 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1077208093_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/export-test/export-1689149764310/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/export-test/export-1689149764310/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:19,617 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(367): hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/export-test/export-1689149764310/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-12 08:16:19,617 DEBUG [Listener at jenkins-hbase4.apache.org/39391] snapshot.TestExportSnapshot(367): hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/export-test/export-1689149764310/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-12 08:16:19,626 INFO [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:19,626 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:19,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:19,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-12 08:16:19,633 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149779633"}]},"ts":"1689149779633"} 2023-07-12 08:16:19,635 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-12 08:16:19,636 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-12 08:16:19,637 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e7f643482fd40d1e5a343da242bd3ba1, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=64adf4576c42b15b4ca2955349085e51, UNASSIGN}] 2023-07-12 08:16:19,638 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=64adf4576c42b15b4ca2955349085e51, UNASSIGN 2023-07-12 08:16:19,640 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e7f643482fd40d1e5a343da242bd3ba1, UNASSIGN 2023-07-12 08:16:19,643 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=e7f643482fd40d1e5a343da242bd3ba1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:16:19,643 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=64adf4576c42b15b4ca2955349085e51, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:16:19,651 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689149761134.64adf4576c42b15b4ca2955349085e51.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689149779643"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149779643"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149779643"}]},"ts":"1689149779643"} 2023-07-12 08:16:19,652 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689149761134.e7f643482fd40d1e5a343da242bd3ba1.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689149779643"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149779643"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149779643"}]},"ts":"1689149779643"} 2023-07-12 08:16:19,653 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure 64adf4576c42b15b4ca2955349085e51, server=jenkins-hbase4.apache.org,43131,1689149646833}] 2023-07-12 08:16:19,654 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure e7f643482fd40d1e5a343da242bd3ba1, server=jenkins-hbase4.apache.org,43719,1689149646718}] 2023-07-12 08:16:19,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-12 08:16:19,806 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 64adf4576c42b15b4ca2955349085e51 2023-07-12 08:16:19,806 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 64adf4576c42b15b4ca2955349085e51, disabling compactions & flushes 2023-07-12 08:16:19,806 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689149761134.64adf4576c42b15b4ca2955349085e51. 2023-07-12 08:16:19,806 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689149761134.64adf4576c42b15b4ca2955349085e51. 2023-07-12 08:16:19,806 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689149761134.64adf4576c42b15b4ca2955349085e51. after waiting 0 ms 2023-07-12 08:16:19,806 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689149761134.64adf4576c42b15b4ca2955349085e51. 2023-07-12 08:16:19,807 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e7f643482fd40d1e5a343da242bd3ba1 2023-07-12 08:16:19,807 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e7f643482fd40d1e5a343da242bd3ba1, disabling compactions & flushes 2023-07-12 08:16:19,807 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689149761134.e7f643482fd40d1e5a343da242bd3ba1. 2023-07-12 08:16:19,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689149761134.e7f643482fd40d1e5a343da242bd3ba1. 2023-07-12 08:16:19,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689149761134.e7f643482fd40d1e5a343da242bd3ba1. after waiting 0 ms 2023-07-12 08:16:19,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689149761134.e7f643482fd40d1e5a343da242bd3ba1. 2023-07-12 08:16:19,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7f643482fd40d1e5a343da242bd3ba1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 08:16:19,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/default/testtb-testExportFileSystemStateWithSkipTmp/64adf4576c42b15b4ca2955349085e51/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 08:16:19,863 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 08:16:19,863 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 08:16:19,864 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689149761134.e7f643482fd40d1e5a343da242bd3ba1. 2023-07-12 08:16:19,865 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e7f643482fd40d1e5a343da242bd3ba1: 2023-07-12 08:16:19,865 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689149761134.64adf4576c42b15b4ca2955349085e51. 2023-07-12 08:16:19,865 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 64adf4576c42b15b4ca2955349085e51: 2023-07-12 08:16:19,866 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e7f643482fd40d1e5a343da242bd3ba1 2023-07-12 08:16:19,867 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=e7f643482fd40d1e5a343da242bd3ba1, regionState=CLOSED 2023-07-12 08:16:19,867 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689149761134.e7f643482fd40d1e5a343da242bd3ba1.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689149779867"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149779867"}]},"ts":"1689149779867"} 2023-07-12 08:16:19,867 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 64adf4576c42b15b4ca2955349085e51 2023-07-12 08:16:19,868 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=64adf4576c42b15b4ca2955349085e51, regionState=CLOSED 2023-07-12 08:16:19,868 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689149761134.64adf4576c42b15b4ca2955349085e51.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689149779868"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149779868"}]},"ts":"1689149779868"} 2023-07-12 08:16:19,870 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=115 2023-07-12 08:16:19,871 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure e7f643482fd40d1e5a343da242bd3ba1, server=jenkins-hbase4.apache.org,43719,1689149646718 in 215 msec 2023-07-12 08:16:19,872 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=116 2023-07-12 08:16:19,872 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure 64adf4576c42b15b4ca2955349085e51, server=jenkins-hbase4.apache.org,43131,1689149646833 in 217 msec 2023-07-12 08:16:19,872 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e7f643482fd40d1e5a343da242bd3ba1, UNASSIGN in 233 msec 2023-07-12 08:16:19,873 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-12 08:16:19,873 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=64adf4576c42b15b4ca2955349085e51, UNASSIGN in 235 msec 2023-07-12 08:16:19,874 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149779874"}]},"ts":"1689149779874"} 2023-07-12 08:16:19,875 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-12 08:16:19,876 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-12 08:16:19,881 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 249 msec 2023-07-12 08:16:19,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-12 08:16:19,934 INFO [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-12 08:16:19,935 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:19,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:19,939 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:19,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:19,940 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:19,941 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46655] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:19,943 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:19,943 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:19,944 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:19,944 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:19,944 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-12 08:16:19,944 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-12 08:16:19,944 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-12 08:16:19,945 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-12 08:16:19,947 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:19,947 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:16:19,947 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:19,947 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:16:19,947 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:19,947 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:16:19,948 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:19,948 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:16:19,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-12 08:16:19,951 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7f643482fd40d1e5a343da242bd3ba1 2023-07-12 08:16:19,951 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/64adf4576c42b15b4ca2955349085e51 2023-07-12 08:16:19,953 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7f643482fd40d1e5a343da242bd3ba1/cf, FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7f643482fd40d1e5a343da242bd3ba1/recovered.edits] 2023-07-12 08:16:19,953 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/64adf4576c42b15b4ca2955349085e51/cf, FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/64adf4576c42b15b4ca2955349085e51/recovered.edits] 2023-07-12 08:16:19,959 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/64adf4576c42b15b4ca2955349085e51/cf/ee660bbb2aa1497da82b33ff0d3d8a5f to hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/64adf4576c42b15b4ca2955349085e51/cf/ee660bbb2aa1497da82b33ff0d3d8a5f 2023-07-12 08:16:19,959 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7f643482fd40d1e5a343da242bd3ba1/cf/27a579a2932c474eb1f66c826cc1d167 to hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7f643482fd40d1e5a343da242bd3ba1/cf/27a579a2932c474eb1f66c826cc1d167 2023-07-12 08:16:19,963 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7f643482fd40d1e5a343da242bd3ba1/recovered.edits/9.seqid to hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7f643482fd40d1e5a343da242bd3ba1/recovered.edits/9.seqid 2023-07-12 08:16:19,963 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/64adf4576c42b15b4ca2955349085e51/recovered.edits/9.seqid to hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/64adf4576c42b15b4ca2955349085e51/recovered.edits/9.seqid 2023-07-12 08:16:19,964 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7f643482fd40d1e5a343da242bd3ba1 2023-07-12 08:16:19,964 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/64adf4576c42b15b4ca2955349085e51 2023-07-12 08:16:19,964 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-12 08:16:19,966 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:19,968 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-12 08:16:19,970 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-12 08:16:19,971 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:19,971 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-12 08:16:19,971 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689149761134.e7f643482fd40d1e5a343da242bd3ba1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689149779971"}]},"ts":"9223372036854775807"} 2023-07-12 08:16:19,971 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689149761134.64adf4576c42b15b4ca2955349085e51.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689149779971"}]},"ts":"9223372036854775807"} 2023-07-12 08:16:19,974 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 08:16:19,974 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e7f643482fd40d1e5a343da242bd3ba1, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689149761134.e7f643482fd40d1e5a343da242bd3ba1.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 64adf4576c42b15b4ca2955349085e51, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689149761134.64adf4576c42b15b4ca2955349085e51.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 08:16:19,974 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-12 08:16:19,974 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689149779974"}]},"ts":"9223372036854775807"} 2023-07-12 08:16:19,976 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-12 08:16:19,978 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:19,980 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 43 msec 2023-07-12 08:16:20,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-12 08:16:20,051 INFO [Listener at jenkins-hbase4.apache.org/39391] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-12 08:16:20,061 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-12 08:16:20,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:20,064 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-12 08:16:20,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33919] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:20,096 INFO [Listener at jenkins-hbase4.apache.org/39391] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=762 (was 762), OpenFileDescriptor=897 (was 905), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=766 (was 606) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 181), AvailableMemoryMB=2071 (was 2476) 2023-07-12 08:16:20,096 WARN [Listener at jenkins-hbase4.apache.org/39391] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-12 08:16:20,096 INFO [Listener at jenkins-hbase4.apache.org/39391] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-12 08:16:20,109 INFO [Listener at jenkins-hbase4.apache.org/39391] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-12 08:16:23,859 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656036_0007_000001 (auth:SIMPLE) 2023-07-12 08:16:25,447 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 08:16:34,237 INFO [Listener at jenkins-hbase4.apache.org/39391] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-12 08:16:48,367 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-12 08:16:48,368 INFO [Listener at jenkins-hbase4.apache.org/39391] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-12 08:16:48,378 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-12 08:16:48,390 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-12 08:16:48,395 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-12 08:16:48,411 INFO [Listener at jenkins-hbase4.apache.org/39391] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-12 08:16:48,515 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-12 08:16:48,515 INFO [Listener at jenkins-hbase4.apache.org/39391] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-12 08:16:48,516 INFO [Listener at jenkins-hbase4.apache.org/39391] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-12 08:16:48,516 INFO [Listener at jenkins-hbase4.apache.org/39391] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-12 08:16:48,516 DEBUG [Listener at jenkins-hbase4.apache.org/39391] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x60c901b5 to 127.0.0.1:54842 2023-07-12 08:16:48,516 DEBUG [Listener at jenkins-hbase4.apache.org/39391] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:16:48,516 DEBUG [Listener at jenkins-hbase4.apache.org/39391] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-12 08:16:48,516 DEBUG [Listener at jenkins-hbase4.apache.org/39391] util.JVMClusterUtil(257): Found active master hash=1658197941, stopped=false 2023-07-12 08:16:48,517 DEBUG [Listener at jenkins-hbase4.apache.org/39391] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 08:16:48,517 DEBUG [Listener at jenkins-hbase4.apache.org/39391] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-12 08:16:48,517 INFO [Listener at jenkins-hbase4.apache.org/39391] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,33919,1689149645203 2023-07-12 08:16:48,518 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 08:16:48,518 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 08:16:48,518 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 08:16:48,518 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 08:16:48,519 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 08:16:48,522 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 08:16:48,522 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 08:16:48,522 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 08:16:48,522 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 08:16:48,522 INFO [Listener at jenkins-hbase4.apache.org/39391] procedure2.ProcedureExecutor(629): Stopping 2023-07-12 08:16:48,522 DEBUG [Listener at jenkins-hbase4.apache.org/39391] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x775a92dc to 127.0.0.1:54842 2023-07-12 08:16:48,523 DEBUG [Listener at jenkins-hbase4.apache.org/39391] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:16:48,523 INFO [Listener at jenkins-hbase4.apache.org/39391] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,43719,1689149646718' ***** 2023-07-12 08:16:48,523 DEBUG [Listener at jenkins-hbase4.apache.org/39391] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 08:16:48,523 INFO [Listener at jenkins-hbase4.apache.org/39391] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-12 08:16:48,523 INFO [Listener at jenkins-hbase4.apache.org/39391] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,43131,1689149646833' ***** 2023-07-12 08:16:48,523 DEBUG [Listener at jenkins-hbase4.apache.org/39391] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 08:16:48,523 INFO [Listener at jenkins-hbase4.apache.org/39391] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-12 08:16:48,523 INFO [Listener at jenkins-hbase4.apache.org/39391] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,46655,1689149646904' ***** 2023-07-12 08:16:48,523 DEBUG [Listener at jenkins-hbase4.apache.org/39391] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 08:16:48,524 INFO [Listener at jenkins-hbase4.apache.org/39391] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-12 08:16:48,524 INFO [RS:0;jenkins-hbase4:43719] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 08:16:48,524 INFO [RS:2;jenkins-hbase4:46655] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 08:16:48,524 INFO [RS:1;jenkins-hbase4:43131] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 08:16:48,524 INFO [RS:0;jenkins-hbase4:43719] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-12 08:16:48,524 INFO [RS:0;jenkins-hbase4:43719] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-12 08:16:48,524 INFO [RS:1;jenkins-hbase4:43131] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-12 08:16:48,524 INFO [RS:0;jenkins-hbase4:43719] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:16:48,524 INFO [RS:1;jenkins-hbase4:43131] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-12 08:16:48,524 DEBUG [RS:0;jenkins-hbase4:43719] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x14d131f2 to 127.0.0.1:54842 2023-07-12 08:16:48,525 INFO [RS:1;jenkins-hbase4:43131] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:16:48,525 DEBUG [RS:1;jenkins-hbase4:43131] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x51d36f56 to 127.0.0.1:54842 2023-07-12 08:16:48,525 DEBUG [RS:1;jenkins-hbase4:43131] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:16:48,525 INFO [RS:2;jenkins-hbase4:46655] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-12 08:16:48,528 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 08:16:48,524 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 08:16:48,528 INFO [RS:1;jenkins-hbase4:43131] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-12 08:16:48,528 INFO [RS:2;jenkins-hbase4:46655] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-12 08:16:48,528 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 08:16:48,525 DEBUG [RS:0;jenkins-hbase4:43719] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:16:48,528 INFO [RS:1;jenkins-hbase4:43131] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-12 08:16:48,529 INFO [RS:0;jenkins-hbase4:43719] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,43719,1689149646718; all regions closed. 2023-07-12 08:16:48,529 INFO [RS:2;jenkins-hbase4:46655] regionserver.HRegionServer(3305): Received CLOSE for 4556439624b5cc6fd5a7f8deec800c71 2023-07-12 08:16:48,529 INFO [RS:1;jenkins-hbase4:43131] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-12 08:16:48,529 INFO [RS:1;jenkins-hbase4:43131] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-12 08:16:48,530 INFO [RS:2;jenkins-hbase4:46655] regionserver.HRegionServer(3305): Received CLOSE for 4be4e65e0617efa6b1ad96ebdfd8c325 2023-07-12 08:16:48,530 INFO [RS:1;jenkins-hbase4:43131] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-12 08:16:48,530 DEBUG [RS:1;jenkins-hbase4:43131] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-07-12 08:16:48,530 INFO [RS:2;jenkins-hbase4:46655] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:16:48,543 DEBUG [RS:2;jenkins-hbase4:46655] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x58fd479a to 127.0.0.1:54842 2023-07-12 08:16:48,543 DEBUG [RS:2;jenkins-hbase4:46655] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:16:48,531 DEBUG [RS:1;jenkins-hbase4:43131] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-12 08:16:48,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4556439624b5cc6fd5a7f8deec800c71, disabling compactions & flushes 2023-07-12 08:16:48,544 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-12 08:16:48,544 INFO [RS:2;jenkins-hbase4:46655] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-12 08:16:48,545 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-12 08:16:48,544 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689149649844.4556439624b5cc6fd5a7f8deec800c71. 2023-07-12 08:16:48,545 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-12 08:16:48,545 DEBUG [RS:2;jenkins-hbase4:46655] regionserver.HRegionServer(1478): Online Regions={4556439624b5cc6fd5a7f8deec800c71=hbase:namespace,,1689149649844.4556439624b5cc6fd5a7f8deec800c71., 4be4e65e0617efa6b1ad96ebdfd8c325=hbase:acl,,1689149650595.4be4e65e0617efa6b1ad96ebdfd8c325.} 2023-07-12 08:16:48,545 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-12 08:16:48,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689149649844.4556439624b5cc6fd5a7f8deec800c71. 2023-07-12 08:16:48,545 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-12 08:16:48,545 DEBUG [RS:2;jenkins-hbase4:46655] regionserver.HRegionServer(1504): Waiting on 4556439624b5cc6fd5a7f8deec800c71, 4be4e65e0617efa6b1ad96ebdfd8c325 2023-07-12 08:16:48,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689149649844.4556439624b5cc6fd5a7f8deec800c71. after waiting 0 ms 2023-07-12 08:16:48,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689149649844.4556439624b5cc6fd5a7f8deec800c71. 2023-07-12 08:16:48,545 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-12 08:16:48,545 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 4556439624b5cc6fd5a7f8deec800c71 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-12 08:16:48,556 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 08:16:48,581 DEBUG [RS:0;jenkins-hbase4:43719] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/oldWALs 2023-07-12 08:16:48,581 INFO [RS:0;jenkins-hbase4:43719] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43719%2C1689149646718:(num 1689149649042) 2023-07-12 08:16:48,581 DEBUG [RS:0;jenkins-hbase4:43719] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:16:48,581 INFO [RS:0;jenkins-hbase4:43719] regionserver.LeaseManager(133): Closed leases 2023-07-12 08:16:48,582 INFO [RS:0;jenkins-hbase4:43719] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-12 08:16:48,583 INFO [RS:0;jenkins-hbase4:43719] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-12 08:16:48,583 INFO [RS:0;jenkins-hbase4:43719] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-12 08:16:48,583 INFO [RS:0;jenkins-hbase4:43719] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-12 08:16:48,583 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 08:16:48,584 INFO [RS:0;jenkins-hbase4:43719] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43719 2023-07-12 08:16:48,600 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:16:48,600 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:16:48,600 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 08:16:48,600 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 08:16:48,600 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 08:16:48,600 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43719,1689149646718 2023-07-12 08:16:48,600 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 08:16:48,600 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43719,1689149646718] 2023-07-12 08:16:48,604 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43719,1689149646718; numProcessing=1 2023-07-12 08:16:48,608 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 08:16:48,613 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43719,1689149646718 already deleted, retry=false 2023-07-12 08:16:48,613 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43719,1689149646718 expired; onlineServers=2 2023-07-12 08:16:48,616 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 08:16:48,646 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/hbase/namespace/4556439624b5cc6fd5a7f8deec800c71/.tmp/info/b13ae86bbdb3417bb62fdb2faa3e191f 2023-07-12 08:16:48,662 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/hbase/meta/1588230740/.tmp/info/50665ef3533a47f9b6018f93b48c4d9e 2023-07-12 08:16:48,685 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/hbase/namespace/4556439624b5cc6fd5a7f8deec800c71/.tmp/info/b13ae86bbdb3417bb62fdb2faa3e191f as hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/hbase/namespace/4556439624b5cc6fd5a7f8deec800c71/info/b13ae86bbdb3417bb62fdb2faa3e191f 2023-07-12 08:16:48,689 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 50665ef3533a47f9b6018f93b48c4d9e 2023-07-12 08:16:48,693 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/hbase/namespace/4556439624b5cc6fd5a7f8deec800c71/info/b13ae86bbdb3417bb62fdb2faa3e191f, entries=2, sequenceid=6, filesize=4.8 K 2023-07-12 08:16:48,694 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 4556439624b5cc6fd5a7f8deec800c71 in 149ms, sequenceid=6, compaction requested=false 2023-07-12 08:16:48,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/hbase/namespace/4556439624b5cc6fd5a7f8deec800c71/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 08:16:48,704 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 08:16:48,711 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689149649844.4556439624b5cc6fd5a7f8deec800c71. 2023-07-12 08:16:48,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4556439624b5cc6fd5a7f8deec800c71: 2023-07-12 08:16:48,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689149649844.4556439624b5cc6fd5a7f8deec800c71. 2023-07-12 08:16:48,712 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4be4e65e0617efa6b1ad96ebdfd8c325, disabling compactions & flushes 2023-07-12 08:16:48,712 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689149650595.4be4e65e0617efa6b1ad96ebdfd8c325. 2023-07-12 08:16:48,712 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689149650595.4be4e65e0617efa6b1ad96ebdfd8c325. 2023-07-12 08:16:48,712 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689149650595.4be4e65e0617efa6b1ad96ebdfd8c325. after waiting 0 ms 2023-07-12 08:16:48,712 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689149650595.4be4e65e0617efa6b1ad96ebdfd8c325. 2023-07-12 08:16:48,712 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 4be4e65e0617efa6b1ad96ebdfd8c325 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-12 08:16:48,713 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 08:16:48,713 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43719-0x1015898a0960001, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 08:16:48,713 INFO [RS:0;jenkins-hbase4:43719] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,43719,1689149646718; zookeeper connection closed. 2023-07-12 08:16:48,714 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2c342c36] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2c342c36 2023-07-12 08:16:48,719 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/hbase/meta/1588230740/.tmp/rep_barrier/f396ca3f0912446ca0227f4425901d56 2023-07-12 08:16:48,731 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f396ca3f0912446ca0227f4425901d56 2023-07-12 08:16:48,745 DEBUG [RS:2;jenkins-hbase4:46655] regionserver.HRegionServer(1504): Waiting on 4be4e65e0617efa6b1ad96ebdfd8c325 2023-07-12 08:16:48,751 DEBUG [RS:1;jenkins-hbase4:43131] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-12 08:16:48,763 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/hbase/meta/1588230740/.tmp/table/b8c21c13d3a94199a2d92042ad8a7625 2023-07-12 08:16:48,768 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b8c21c13d3a94199a2d92042ad8a7625 2023-07-12 08:16:48,769 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/hbase/meta/1588230740/.tmp/info/50665ef3533a47f9b6018f93b48c4d9e as hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/hbase/meta/1588230740/info/50665ef3533a47f9b6018f93b48c4d9e 2023-07-12 08:16:48,776 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 50665ef3533a47f9b6018f93b48c4d9e 2023-07-12 08:16:48,776 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/hbase/meta/1588230740/info/50665ef3533a47f9b6018f93b48c4d9e, entries=48, sequenceid=131, filesize=10.3 K 2023-07-12 08:16:48,779 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/hbase/meta/1588230740/.tmp/rep_barrier/f396ca3f0912446ca0227f4425901d56 as hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/hbase/meta/1588230740/rep_barrier/f396ca3f0912446ca0227f4425901d56 2023-07-12 08:16:48,783 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f396ca3f0912446ca0227f4425901d56 2023-07-12 08:16:48,784 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/hbase/meta/1588230740/rep_barrier/f396ca3f0912446ca0227f4425901d56, entries=13, sequenceid=131, filesize=6.4 K 2023-07-12 08:16:48,784 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/hbase/meta/1588230740/.tmp/table/b8c21c13d3a94199a2d92042ad8a7625 as hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/hbase/meta/1588230740/table/b8c21c13d3a94199a2d92042ad8a7625 2023-07-12 08:16:48,789 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b8c21c13d3a94199a2d92042ad8a7625 2023-07-12 08:16:48,789 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/hbase/meta/1588230740/table/b8c21c13d3a94199a2d92042ad8a7625, entries=24, sequenceid=131, filesize=6.9 K 2023-07-12 08:16:48,790 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 244ms, sequenceid=131, compaction requested=false 2023-07-12 08:16:48,805 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-12 08:16:48,806 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 08:16:48,806 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-12 08:16:48,807 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-12 08:16:48,807 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-12 08:16:48,807 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-12 08:16:48,824 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-12 08:16:48,825 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-12 08:16:48,865 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-12 08:16:48,865 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-12 08:16:48,945 DEBUG [RS:2;jenkins-hbase4:46655] regionserver.HRegionServer(1504): Waiting on 4be4e65e0617efa6b1ad96ebdfd8c325 2023-07-12 08:16:48,951 INFO [RS:1;jenkins-hbase4:43131] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,43131,1689149646833; all regions closed. 2023-07-12 08:16:48,962 DEBUG [RS:1;jenkins-hbase4:43131] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/oldWALs 2023-07-12 08:16:48,962 INFO [RS:1;jenkins-hbase4:43131] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43131%2C1689149646833.meta:.meta(num 1689149649401) 2023-07-12 08:16:48,975 DEBUG [RS:1;jenkins-hbase4:43131] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/oldWALs 2023-07-12 08:16:48,975 INFO [RS:1;jenkins-hbase4:43131] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43131%2C1689149646833:(num 1689149649042) 2023-07-12 08:16:48,975 DEBUG [RS:1;jenkins-hbase4:43131] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:16:48,975 INFO [RS:1;jenkins-hbase4:43131] regionserver.LeaseManager(133): Closed leases 2023-07-12 08:16:48,975 INFO [RS:1;jenkins-hbase4:43131] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-12 08:16:48,976 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 08:16:48,977 INFO [RS:1;jenkins-hbase4:43131] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43131 2023-07-12 08:16:48,980 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:16:48,980 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43131,1689149646833 2023-07-12 08:16:48,980 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 08:16:48,982 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43131,1689149646833] 2023-07-12 08:16:48,982 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43131,1689149646833; numProcessing=2 2023-07-12 08:16:48,983 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43131,1689149646833 already deleted, retry=false 2023-07-12 08:16:48,983 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43131,1689149646833 expired; onlineServers=1 2023-07-12 08:16:49,082 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 08:16:49,082 INFO [RS:1;jenkins-hbase4:43131] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,43131,1689149646833; zookeeper connection closed. 2023-07-12 08:16:49,083 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:43131-0x1015898a0960002, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 08:16:49,083 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7e41987] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7e41987 2023-07-12 08:16:49,139 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/hbase/acl/4be4e65e0617efa6b1ad96ebdfd8c325/.tmp/l/1430d64b717448b8bbc69d187bcf355d 2023-07-12 08:16:49,144 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1430d64b717448b8bbc69d187bcf355d 2023-07-12 08:16:49,145 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/hbase/acl/4be4e65e0617efa6b1ad96ebdfd8c325/.tmp/l/1430d64b717448b8bbc69d187bcf355d as hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/hbase/acl/4be4e65e0617efa6b1ad96ebdfd8c325/l/1430d64b717448b8bbc69d187bcf355d 2023-07-12 08:16:49,146 DEBUG [RS:2;jenkins-hbase4:46655] regionserver.HRegionServer(1504): Waiting on 4be4e65e0617efa6b1ad96ebdfd8c325 2023-07-12 08:16:49,150 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1430d64b717448b8bbc69d187bcf355d 2023-07-12 08:16:49,150 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/hbase/acl/4be4e65e0617efa6b1ad96ebdfd8c325/l/1430d64b717448b8bbc69d187bcf355d, entries=7, sequenceid=18, filesize=5.2 K 2023-07-12 08:16:49,151 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 4be4e65e0617efa6b1ad96ebdfd8c325 in 439ms, sequenceid=18, compaction requested=false 2023-07-12 08:16:49,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/data/hbase/acl/4be4e65e0617efa6b1ad96ebdfd8c325/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-12 08:16:49,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 08:16:49,159 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689149650595.4be4e65e0617efa6b1ad96ebdfd8c325. 2023-07-12 08:16:49,159 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4be4e65e0617efa6b1ad96ebdfd8c325: 2023-07-12 08:16:49,159 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689149650595.4be4e65e0617efa6b1ad96ebdfd8c325. 2023-07-12 08:16:49,346 INFO [RS:2;jenkins-hbase4:46655] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,46655,1689149646904; all regions closed. 2023-07-12 08:16:49,351 DEBUG [RS:2;jenkins-hbase4:46655] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/oldWALs 2023-07-12 08:16:49,351 INFO [RS:2;jenkins-hbase4:46655] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46655%2C1689149646904:(num 1689149649042) 2023-07-12 08:16:49,351 DEBUG [RS:2;jenkins-hbase4:46655] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:16:49,351 INFO [RS:2;jenkins-hbase4:46655] regionserver.LeaseManager(133): Closed leases 2023-07-12 08:16:49,351 INFO [RS:2;jenkins-hbase4:46655] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-12 08:16:49,351 INFO [RS:2;jenkins-hbase4:46655] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-12 08:16:49,351 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 08:16:49,351 INFO [RS:2;jenkins-hbase4:46655] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-12 08:16:49,351 INFO [RS:2;jenkins-hbase4:46655] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-12 08:16:49,352 INFO [RS:2;jenkins-hbase4:46655] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46655 2023-07-12 08:16:49,354 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46655,1689149646904 2023-07-12 08:16:49,354 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 08:16:49,356 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46655,1689149646904] 2023-07-12 08:16:49,356 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46655,1689149646904; numProcessing=3 2023-07-12 08:16:49,357 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46655,1689149646904 already deleted, retry=false 2023-07-12 08:16:49,357 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,46655,1689149646904 expired; onlineServers=0 2023-07-12 08:16:49,357 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,33919,1689149645203' ***** 2023-07-12 08:16:49,357 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-12 08:16:49,357 DEBUG [M:0;jenkins-hbase4:33919] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@23eb1d8e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-12 08:16:49,357 INFO [M:0;jenkins-hbase4:33919] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,33919,1689149645203 2023-07-12 08:16:49,357 INFO [M:0;jenkins-hbase4:33919] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,33919,1689149645203; all regions closed. 2023-07-12 08:16:49,357 DEBUG [M:0;jenkins-hbase4:33919] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:16:49,357 DEBUG [M:0;jenkins-hbase4:33919] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-12 08:16:49,358 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-12 08:16:49,358 DEBUG [M:0;jenkins-hbase4:33919] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-12 08:16:49,358 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689149648550] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689149648550,5,FailOnTimeoutGroup] 2023-07-12 08:16:49,358 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689149648551] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689149648551,5,FailOnTimeoutGroup] 2023-07-12 08:16:49,358 INFO [M:0;jenkins-hbase4:33919] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-12 08:16:49,358 INFO [M:0;jenkins-hbase4:33919] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-12 08:16:49,358 INFO [M:0;jenkins-hbase4:33919] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-12 08:16:49,358 DEBUG [M:0;jenkins-hbase4:33919] master.HMaster(1512): Stopping service threads 2023-07-12 08:16:49,358 INFO [M:0;jenkins-hbase4:33919] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-12 08:16:49,358 ERROR [M:0;jenkins-hbase4:33919] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-12 08:16:49,359 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-12 08:16:49,359 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 08:16:49,359 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 08:16:49,359 INFO [M:0;jenkins-hbase4:33919] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-12 08:16:49,359 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-12 08:16:49,359 DEBUG [M:0;jenkins-hbase4:33919] zookeeper.ZKUtil(398): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-12 08:16:49,360 WARN [M:0;jenkins-hbase4:33919] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-12 08:16:49,360 INFO [M:0;jenkins-hbase4:33919] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-12 08:16:49,360 INFO [M:0;jenkins-hbase4:33919] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-12 08:16:49,360 DEBUG [M:0;jenkins-hbase4:33919] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-12 08:16:49,360 INFO [M:0;jenkins-hbase4:33919] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 08:16:49,360 DEBUG [M:0;jenkins-hbase4:33919] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 08:16:49,360 DEBUG [M:0;jenkins-hbase4:33919] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-12 08:16:49,360 DEBUG [M:0;jenkins-hbase4:33919] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 08:16:49,361 INFO [M:0;jenkins-hbase4:33919] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=373.12 KB heapSize=449.34 KB 2023-07-12 08:16:49,373 INFO [M:0;jenkins-hbase4:33919] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=373.12 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/bfa2e04f537d42cd95502817643923e5 2023-07-12 08:16:49,377 INFO [M:0;jenkins-hbase4:33919] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bfa2e04f537d42cd95502817643923e5 2023-07-12 08:16:49,377 DEBUG [M:0;jenkins-hbase4:33919] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/bfa2e04f537d42cd95502817643923e5 as hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/bfa2e04f537d42cd95502817643923e5 2023-07-12 08:16:49,381 INFO [M:0;jenkins-hbase4:33919] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bfa2e04f537d42cd95502817643923e5 2023-07-12 08:16:49,381 INFO [M:0;jenkins-hbase4:33919] regionserver.HStore(1080): Added hdfs://localhost:34597/user/jenkins/test-data/00bda281-45e4-0429-1c6b-4b843b9203c4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/bfa2e04f537d42cd95502817643923e5, entries=119, sequenceid=899, filesize=28.4 K 2023-07-12 08:16:49,382 INFO [M:0;jenkins-hbase4:33919] regionserver.HRegion(2948): Finished flush of dataSize ~373.12 KB/382074, heapSize ~449.32 KB/460104, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 22ms, sequenceid=899, compaction requested=false 2023-07-12 08:16:49,384 INFO [M:0;jenkins-hbase4:33919] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 08:16:49,384 DEBUG [M:0;jenkins-hbase4:33919] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 08:16:49,388 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 08:16:49,388 INFO [M:0;jenkins-hbase4:33919] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-12 08:16:49,389 INFO [M:0;jenkins-hbase4:33919] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33919 2023-07-12 08:16:49,390 DEBUG [M:0;jenkins-hbase4:33919] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,33919,1689149645203 already deleted, retry=false 2023-07-12 08:16:49,456 INFO [RS:2;jenkins-hbase4:46655] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,46655,1689149646904; zookeeper connection closed. 2023-07-12 08:16:49,456 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 08:16:49,456 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): regionserver:46655-0x1015898a0960003, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 08:16:49,457 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@11c6f78b] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@11c6f78b 2023-07-12 08:16:49,457 INFO [Listener at jenkins-hbase4.apache.org/39391] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-12 08:16:49,556 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 08:16:49,556 INFO [M:0;jenkins-hbase4:33919] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,33919,1689149645203; zookeeper connection closed. 2023-07-12 08:16:49,556 DEBUG [Listener at localhost/46217-EventThread] zookeeper.ZKWatcher(600): master:33919-0x1015898a0960000, quorum=127.0.0.1:54842, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 08:16:49,558 WARN [Listener at jenkins-hbase4.apache.org/39391] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 08:16:49,562 INFO [Listener at jenkins-hbase4.apache.org/39391] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 08:16:49,666 WARN [BP-1215297867-172.31.14.131-1689149640677 heartbeating to localhost/127.0.0.1:34597] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 08:16:49,666 WARN [BP-1215297867-172.31.14.131-1689149640677 heartbeating to localhost/127.0.0.1:34597] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1215297867-172.31.14.131-1689149640677 (Datanode Uuid 4d216d80-2690-4120-b321-e4433ee1727e) service to localhost/127.0.0.1:34597 2023-07-12 08:16:49,668 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/cluster_1daca596-97fc-0b49-6883-d88e991fb0ab/dfs/data/data5/current/BP-1215297867-172.31.14.131-1689149640677] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 08:16:49,669 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/cluster_1daca596-97fc-0b49-6883-d88e991fb0ab/dfs/data/data6/current/BP-1215297867-172.31.14.131-1689149640677] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 08:16:49,671 WARN [Listener at jenkins-hbase4.apache.org/39391] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 08:16:49,687 INFO [Listener at jenkins-hbase4.apache.org/39391] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 08:16:49,790 WARN [BP-1215297867-172.31.14.131-1689149640677 heartbeating to localhost/127.0.0.1:34597] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 08:16:49,790 WARN [BP-1215297867-172.31.14.131-1689149640677 heartbeating to localhost/127.0.0.1:34597] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1215297867-172.31.14.131-1689149640677 (Datanode Uuid c70d66d5-ffa2-4212-acb5-f5be10ddec4a) service to localhost/127.0.0.1:34597 2023-07-12 08:16:49,791 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/cluster_1daca596-97fc-0b49-6883-d88e991fb0ab/dfs/data/data3/current/BP-1215297867-172.31.14.131-1689149640677] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 08:16:49,792 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/cluster_1daca596-97fc-0b49-6883-d88e991fb0ab/dfs/data/data4/current/BP-1215297867-172.31.14.131-1689149640677] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 08:16:49,796 WARN [Listener at jenkins-hbase4.apache.org/39391] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 08:16:49,804 INFO [Listener at jenkins-hbase4.apache.org/39391] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 08:16:49,909 WARN [BP-1215297867-172.31.14.131-1689149640677 heartbeating to localhost/127.0.0.1:34597] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 08:16:49,909 WARN [BP-1215297867-172.31.14.131-1689149640677 heartbeating to localhost/127.0.0.1:34597] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1215297867-172.31.14.131-1689149640677 (Datanode Uuid 08b43db0-c6f6-48a1-a024-40dd6a072085) service to localhost/127.0.0.1:34597 2023-07-12 08:16:49,910 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/cluster_1daca596-97fc-0b49-6883-d88e991fb0ab/dfs/data/data1/current/BP-1215297867-172.31.14.131-1689149640677] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 08:16:49,910 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/66fdcdd5-ba7d-0eb1-cc9e-e779ef718c64/cluster_1daca596-97fc-0b49-6883-d88e991fb0ab/dfs/data/data2/current/BP-1215297867-172.31.14.131-1689149640677] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 08:16:49,934 INFO [Listener at jenkins-hbase4.apache.org/39391] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 08:16:50,060 INFO [Listener at jenkins-hbase4.apache.org/39391] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-12 08:16:50,159 INFO [Listener at jenkins-hbase4.apache.org/39391] hbase.HBaseTestingUtility(1293): Minicluster is down